-- Logs begin at Fri 2022-09-09 12:04:45 UTC, end at Fri 2022-09-09 13:16:51 UTC. -- Sep 09 12:47:07.745055 dv-cinder-813229-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 12:47:07.754915 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 12:47:07.755985 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 12:47:07 2022] *** Sep 09 12:47:07.755985 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 12:47:07.755985 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 12:47:07.755985 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: nodename: dv-cinder-813229-14-iscsi Sep 09 12:47:07.755985 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: machine: x86_64 Sep 09 12:47:07.755985 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: clock source: unix Sep 09 12:47:07.755985 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: pcre jit disabled Sep 09 12:47:07.755985 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: detected number of CPU cores: 4 Sep 09 12:47:07.755985 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: current working directory: / Sep 09 12:47:07.755985 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: detected binary path: /usr/bin/uwsgi-core Sep 09 12:47:07.757234 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: your processes number limit is 47680 Sep 09 12:47:07.757234 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: your memory page size is 4096 bytes Sep 09 12:47:07.757234 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: detected max file descriptor number: 2048 Sep 09 12:47:07.757234 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: lock engine: pthread robust mutexes Sep 09 12:47:07.757234 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: thunder lock: enabled Sep 09 12:47:07.757234 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 12:47:07.757234 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 12:47:07.794566 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: Python main interpreter initialized at 0x558622ab69c0 Sep 09 12:47:07.794566 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: python threads support enabled Sep 09 12:47:07.794566 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: your server socket listen backlog is limited to 100 connections Sep 09 12:47:07.794566 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: your mercy for graceful operations on workers is 90 seconds Sep 09 12:47:07.794897 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 12:47:07.794974 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: *** Operational MODE: preforking *** Sep 09 12:47:07.795213 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: *** uWSGI is running in multiple interpreter mode *** Sep 09 12:47:07.795213 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: spawned uWSGI master process (pid: 112331) Sep 09 12:47:07.795398 dv-cinder-813229-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 12:47:07.795924 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: spawned uWSGI worker 1 (pid: 112332, cores: 1) Sep 09 12:47:07.796244 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: spawned uWSGI worker 2 (pid: 112333, cores: 1) Sep 09 12:47:07.796419 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 12:47:08.468742 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 12:47:08.470177 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 12:47:09.559995 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 12:47:09.559995 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: from cryptography.utils import int_from_bytes Sep 09 12:47:09.560616 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 12:47:09.560616 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: from cryptography.utils import int_from_bytes Sep 09 12:47:09.568469 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 12:47:09.568469 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: from cryptography.utils import int_from_bytes Sep 09 12:47:09.568900 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 12:47:09.568900 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: from cryptography.utils import int_from_bytes Sep 09 12:47:12.017443 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 12:47:12.017999 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 12:47:12.018202 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 12:47:12.019184 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 12:47:12.019544 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 12:47:12.019899 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.020222 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.020541 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.020856 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.021183 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.021269 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 12:47:12.021617 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 12:47:12.021710 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.021788 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.021984 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 12:47:12.022087 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.022342 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 12:47:12.022443 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.022629 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 12:47:12.022718 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.022976 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.023061 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.023296 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813229-14-iscsi {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.023441 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.023616 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.023705 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.023922 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.024014 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.024229 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.024316 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.024545 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.024632 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.024848 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.024946 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.025167 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.025259 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.025467 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.025553 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.025747 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.025966 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.026087 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.027150 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813229-14-iscsi {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.027298 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.027417 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.027507 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.027597 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.027683 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.027770 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.027898 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.027993 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.028073 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.028164 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.028244 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.028376 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.028460 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.028538 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.028749 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.028836 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.028986 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.029130 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.029298 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.029520 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813229-14-iscsi {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.029620 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.029835 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.029921 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.030147 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.030294 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.030459 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.030608 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.030836 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.030921 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.031155 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.031243 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.031462 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.031546 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.031778 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.031864 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.032091 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.032198 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.032400 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.032496 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813229-14-iscsi {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.032724 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.032810 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.033039 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.033125 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.033354 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.033449 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.033669 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.033779 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.033969 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.034090 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.034321 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.034676 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.034771 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.034853 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.034993 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.035192 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.035280 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.035500 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.035586 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.035828 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.035953 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.036134 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.036254 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.036449 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.036545 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.036764 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.036853 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.037064 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.037151 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.037353 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.037451 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.037571 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.037669 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.037887 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.037989 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.038204 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.038293 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.038537 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.038650 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.038810 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.038901 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.039117 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.039211 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.039433 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.039533 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.039740 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.039829 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.040041 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.040127 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.040293 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.040381 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.040545 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.040632 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.040862 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.040949 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.041183 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.041271 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.041536 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.041634 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.041839 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.041935 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.042158 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.042258 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.042500 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.042588 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.042809 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.042915 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.043114 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.043200 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.043421 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.043520 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.043728 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.043825 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.044037 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.044130 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.044349 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.044441 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.044663 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.044758 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.044966 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.045053 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.045270 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.045356 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.045573 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.045661 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.045957 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.046058 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.046187 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.046272 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.046541 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.046632 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.046776 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.046866 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.047078 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.047166 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.047380 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.047467 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.047693 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.047780 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.047996 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.048084 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.048298 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.048384 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.048600 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.048704 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.048925 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.049027 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.049195 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.049283 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.049495 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.049582 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.049808 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.049963 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.050107 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.050202 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.050416 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.050540 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.050738 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.050840 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.051039 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.051126 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.051341 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.051435 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.051641 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.051737 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.051940 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.052032 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.052253 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.052368 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.052563 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.052671 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.052862 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.052958 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.053163 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.053267 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.053462 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.053639 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.053762 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.053916 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.054063 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.054157 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.054362 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.054461 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.054684 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.054771 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.054988 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.055073 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.055289 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.055377 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.055589 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.055680 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.055901 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.056006 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.056206 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.056311 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.056508 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.056612 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.056813 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.056911 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.057112 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.057207 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.057411 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.057505 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.057715 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.057807 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.058017 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.058103 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.058317 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.058414 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.058640 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.058730 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.058940 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.059028 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.059239 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.059326 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.059538 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.059624 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.059834 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.059922 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.060131 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.060225 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.060425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.060524 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.060737 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.060824 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.061043 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.061128 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.061342 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.061436 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.061643 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.061728 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.061939 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.062031 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.062239 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.062350 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.062580 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.062680 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.062884 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.062982 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.063186 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.063287 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.063487 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.063581 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.063804 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.063890 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.064126 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.064217 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.064436 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.064523 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.064743 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.064828 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.065046 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.065132 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.065366 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.065959 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:47:12.066187 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.066352 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.066652 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.066744 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.066972 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.067069 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.067295 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.067391 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.067611 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.067713 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.067939 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.068026 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.068256 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.068354 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.068565 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.068651 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.068878 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.068984 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.069183 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.069278 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.069497 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.069585 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.069806 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.069892 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.070119 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.070220 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.070694 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.070788 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.071032 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.071131 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.071362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.071462 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.071670 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.071760 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.071989 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.072075 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.072302 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.072401 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.072612 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.072723 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.072919 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.073026 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.073223 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.073325 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.073554 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.073655 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.073861 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.073955 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.074170 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.074281 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.074516 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.074609 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.074814 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.074902 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.075132 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.075221 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.075440 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.075527 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.075744 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.075840 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.076052 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.076143 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.076385 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.076487 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.076663 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.076757 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.076988 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.077076 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.077301 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.077388 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.077616 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.077712 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.077924 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.078017 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.078230 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.078324 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.078566 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.078670 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.078876 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.078971 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.079184 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.079269 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.079488 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.079584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.079791 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.079877 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.080092 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.080179 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.080395 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.080496 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.080703 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.080802 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.081032 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.081651 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.081933 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.082070 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.082255 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.082401 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.082593 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.082735 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.082917 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.083066 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.083227 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.083371 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.083534 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.083679 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.083840 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.083988 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.084146 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.084296 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.084455 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.084598 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.084762 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.084908 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.085082 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.085216 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.085409 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.085506 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.085714 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.085827 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.086045 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.086139 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.086351 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.086553 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.086695 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.086783 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.087004 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.087091 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.087313 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.087412 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.087617 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.087709 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.087929 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.088029 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.088232 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.088327 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.088536 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.088631 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.088838 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.088932 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.089154 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.089241 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.089460 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.089548 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.089765 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.089852 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.090074 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.090168 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.090381 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.090469 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.090721 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.090807 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.091030 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.091117 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.091341 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.091439 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.091653 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.091740 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.091958 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.092054 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.092266 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.092353 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.092568 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.092665 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.092873 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.092994 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.093173 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.093274 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.093480 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.093584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.093780 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.093876 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.094080 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.094175 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.094382 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.094515 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.094703 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.094800 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.095001 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.095096 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.095318 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.095418 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.095622 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.095707 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.095925 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.096032 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.096224 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.096314 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.096523 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.096636 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.096853 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.096977 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.097157 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.097419 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.097511 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.097749 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.097845 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.098053 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.098147 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.098375 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.098466 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.098708 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.098801 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.099013 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.099116 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.099318 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.099451 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.099625 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.099711 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.102521 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.102633 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.102705 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.102787 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.102856 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.102921 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.102996 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.103063 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.103128 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.103192 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.103256 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.103321 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.103393 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.103466 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.103532 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.103597 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.103662 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.103726 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.103798 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.103864 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.103935 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.104000 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.104064 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.104128 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.104207 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.104273 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.104338 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.104419 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.104488 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.104565 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.104632 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.104696 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.104760 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.104836 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.105068 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.105245 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.105354 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.105437 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.105667 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.105789 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.105971 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.106082 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.106277 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.106375 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.106614 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.106709 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.106921 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.107022 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.107236 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.107350 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.107546 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.107634 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.107866 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.107953 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.108172 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.108258 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.108488 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.108575 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.108793 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.108887 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.109100 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.109185 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.109419 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.109537 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.109721 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.109808 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.110032 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.110117 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.110338 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.110434 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.110680 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.110767 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.110988 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.111073 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.111295 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.111380 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.111598 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.111694 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.111896 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.111981 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.112198 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.112294 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.112568 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.112661 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.112892 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.112969 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.113181 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.113284 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.113500 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.113588 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.113810 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.113897 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.114122 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.114221 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.114435 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.114592 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.114803 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.114897 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.115095 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.115198 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.115366 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.115452 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.115682 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.115810 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.115989 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.116113 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.116297 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.116421 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.116606 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.116723 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.116904 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.117028 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.117208 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.117333 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.117511 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.117648 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.122312 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.123039 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.123178 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.123305 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.123305 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.123550 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.123673 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.123793 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.123914 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.124034 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.124163 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.124296 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.124417 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.124537 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.124658 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.124778 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.125001 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.125144 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.125331 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.125465 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.125587 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.125715 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.125845 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.125975 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.126097 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.126218 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.126339 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.126459 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.126630 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.126764 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.126886 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.127012 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.127134 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.127254 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.127384 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.127505 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.127615 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.127734 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.127853 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.128529 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.128811 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.128944 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.129066 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.129187 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.129307 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.129443 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.129573 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.129702 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.129823 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.129943 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.130063 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.130192 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.130313 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.130433 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.130433 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.130667 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.130787 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.130922 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.131044 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.131163 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.131283 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.131402 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.131535 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.131657 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.131787 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.131917 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.132038 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.132157 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.132281 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.132281 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.132519 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.132519 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.132746 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.132865 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.132985 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.133114 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.133236 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.133355 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.133355 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.133582 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.133703 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.133832 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.134040 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.134173 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.134295 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.134415 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.134572 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.134698 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.134827 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.134948 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.135083 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.135202 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.135346 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.135535 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.135675 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.135806 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.135935 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.136057 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.136177 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.136296 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.136424 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.136546 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.136666 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.136788 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.136907 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.137041 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.137163 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.137284 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.137419 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.137572 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.137695 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.137826 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.137948 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.138068 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.138188 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.138308 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.138436 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.138582 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.138705 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.138832 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.138955 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.139083 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.139214 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.139335 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.139456 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.139580 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.139708 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.139829 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.139959 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.140081 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.140201 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.140329 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.140457 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.140579 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.140709 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.140845 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.140975 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.141096 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.141216 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.141336 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.141465 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.141586 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.141714 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.141835 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.141962 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.142093 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.142218 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.142345 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.142467 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.142620 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.142741 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.142873 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.143002 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.143125 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.143245 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.143372 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.143498 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.144224 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.144349 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.144349 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.144577 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.144706 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.144827 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.144956 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.145077 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.145187 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.145306 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.145425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.145572 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.145761 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.145894 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.146017 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.146136 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.146259 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.146389 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.146531 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.146655 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.146775 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.146896 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.147016 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.147150 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.147274 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.147394 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.147514 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.147641 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.147762 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.147881 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.148002 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.148123 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.148244 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.148366 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.148499 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.148633 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.148755 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.148874 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.148995 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.149115 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.149244 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.149367 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.149488 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.149608 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.149728 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.149855 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.149985 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.150114 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.150236 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.150356 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.150477 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.150653 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.150791 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.150921 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.151049 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.151170 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.151290 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.151419 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.151560 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.151683 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.151803 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.151923 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.152043 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.152172 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.152305 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.152428 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.152549 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.152670 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.152796 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.152930 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.153058 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.153180 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.153307 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.153489 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.153615 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.153800 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.153925 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.154105 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.154232 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.154405 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.154564 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.154728 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.154861 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.155036 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.155159 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.155340 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.155474 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.155644 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.155784 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.155969 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.156093 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.156241 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.156375 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.156548 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.156672 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.156872 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.156994 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.157179 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.157383 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.157506 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.157627 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.157778 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.157903 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.158080 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.158205 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.158384 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.158554 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.158718 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.158846 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.159021 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.159166 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.159344 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.159468 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.159668 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.159846 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.159984 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.160108 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.160269 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.160404 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.160587 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.160711 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.160907 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.161033 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.161228 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.161353 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.161530 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.161655 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.161838 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.161973 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.162148 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.162270 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.162451 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.162609 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.162780 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.162905 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.163085 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.163218 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.163391 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.163528 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.163697 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.163822 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.164004 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.164136 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.164311 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.164445 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.164617 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.164749 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.164920 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.165045 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.165226 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.165365 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.165531 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.165657 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.165831 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.165971 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.166175 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.166301 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.166423 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.166603 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.166760 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.166853 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.167066 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.167201 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.167370 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.167468 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.167677 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.167771 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.167985 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.168081 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.168285 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.168404 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.168596 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.168716 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.168907 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.169025 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.169214 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.169318 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.169543 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.169655 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.169853 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.169942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.170157 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.170245 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.170469 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.170602 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.170796 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.170885 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.171107 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.171203 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.171413 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.171518 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.171802 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.171888 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.172108 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.172195 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.172410 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.172510 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.172713 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.172800 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.173034 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.173141 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.173335 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.173428 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.173632 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.173727 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.173932 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.174021 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.174233 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.174328 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.174571 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.174663 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.174991 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.175089 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.175320 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.175434 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.175700 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.175800 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.176009 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.176097 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.176319 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.176424 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.176632 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.176730 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.176961 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.177058 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.177270 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.177356 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.177577 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.177687 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.177882 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.177980 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.178206 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.178293 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.178531 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.178620 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.178848 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.178951 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.179158 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.179261 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.179479 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.179571 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.179801 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.179889 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.180111 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.180262 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.180422 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.180576 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.180722 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.180890 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.181042 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.181215 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.181360 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.181540 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.181668 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.181870 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.181970 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.182178 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.182384 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.182520 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.182727 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.182824 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.183034 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.183130 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.183350 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.183459 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.183673 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.183761 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.183979 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.184068 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.184282 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.184369 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.184593 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.184680 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.184896 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.184985 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.185199 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.185293 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.185518 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.185636 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.185823 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.185992 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.186132 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.186316 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.186441 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.186655 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.186773 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.186979 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.187073 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.187306 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.187408 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.187614 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.187706 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.187921 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.188010 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.188232 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.188320 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.188537 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.188626 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.188842 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.188937 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.189166 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.189262 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.189469 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.189555 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.189776 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.189863 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.190083 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.190179 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.190922 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.191022 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.191302 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.191402 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.191610 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.191806 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.191952 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.192137 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.192257 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.192447 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.192576 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.192773 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.192903 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.193089 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.193232 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.193414 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.193543 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.193742 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.193874 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.194049 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.194195 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.194372 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.194536 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.194711 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.194838 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.195151 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.195315 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.196723 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.196825 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.196903 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.196972 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.197038 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.197103 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.197175 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.197250 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.197318 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.197383 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.197454 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.197548 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.197707 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.197777 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.197843 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.198016 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.198161 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.198330 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.198429 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.198656 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.198759 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.198981 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.199076 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.199288 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.199386 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.199609 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.199696 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.199915 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.200001 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.200218 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.200315 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.200522 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.200607 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.200820 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.200906 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.201127 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.201214 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.201434 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.201521 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.201741 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.201829 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.202054 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.202150 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.202360 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.202448 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.202692 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.202782 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.202998 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.203087 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.203311 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.203399 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.203615 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.203701 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.203928 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.204017 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.204241 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.204328 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.204546 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.204642 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.204850 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.204937 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.205151 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.205247 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.205462 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.205557 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.205778 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.205872 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.206228 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.206377 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.206707 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.206829 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.207013 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.207109 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.207324 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.207429 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.207641 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.207758 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.207957 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.208057 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.208268 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.208438 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.208588 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.208725 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.208859 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.209001 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.209163 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.209305 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.209470 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.209622 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.209783 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.209922 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.210097 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.210245 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.210416 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.210585 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.210776 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.210975 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.211116 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.211307 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.211449 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.211623 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.211763 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.211936 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.212077 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.212249 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.212398 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.212576 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.212715 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.212849 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.212992 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.213162 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.213304 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.213474 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.213616 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.213784 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.213934 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.214100 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.214249 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.214392 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.214554 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.214732 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.214884 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.215044 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.215193 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.215353 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.215507 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.215651 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.215787 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.215956 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.216099 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.216267 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.216416 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.216589 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.216747 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.216901 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.217038 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.217222 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.217366 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.217539 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.217676 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.217835 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.217978 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.218145 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.218300 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.218452 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.218682 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.218832 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.218995 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.219137 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.219327 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.219476 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.219651 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.219794 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.219974 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.220116 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.220285 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.220426 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.220597 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.220746 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.220908 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.221057 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.221202 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.221336 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.221504 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.222159 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.222344 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.222517 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.222670 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.222814 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.222950 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.223083 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.223272 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.223423 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.223581 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.223826 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.223976 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.224145 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.224295 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.224478 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.224625 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.224804 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.225005 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.225154 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.225354 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.225502 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.225668 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.225827 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.225992 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.226147 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.226318 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.226467 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.226659 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.226807 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.226950 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.227091 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.227315 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.227458 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.227599 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.227739 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.227891 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.228038 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.228189 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.228330 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.228470 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.228611 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.228758 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.228912 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.229054 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.229194 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.229341 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.229583 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.229739 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.229899 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.230046 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.230194 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.230336 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.230476 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.230659 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.230811 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.230960 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.231101 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.231242 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.231390 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.231549 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.231694 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.231845 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.231993 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.232134 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.232281 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.232431 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.232573 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.232713 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.232853 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.232993 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.233133 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.233282 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.233429 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.233580 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.233720 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.233860 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.234013 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.234164 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.234312 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.234453 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.234645 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.234787 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.234927 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.235087 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.235237 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.235388 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.235573 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.235719 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.235869 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.236010 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.236150 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.236290 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.236430 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.236571 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.236719 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.236861 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.237008 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.237150 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.237971 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.238217 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.238377 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.238546 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.238695 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.238848 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.238990 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.239131 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.239283 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.239424 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.239565 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.239713 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.239856 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.240004 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.240155 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.240302 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.240444 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.240584 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.240731 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.240916 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.241067 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.241208 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.241348 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.241520 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.241722 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.241877 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.242027 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.242186 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.242335 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.242538 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.242690 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.242844 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.242987 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.243135 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.243277 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.243425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.243576 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.243717 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.243858 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.244008 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.244223 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.244398 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.244554 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.244735 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.244890 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.245060 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.245216 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.245398 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.245559 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.245701 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.245842 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.245990 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.246142 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.246290 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.246431 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.246602 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.246745 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.246936 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.247083 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.247240 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.247382 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.247553 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.247708 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.247849 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.248008 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.248159 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.248299 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.248440 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.248580 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.248745 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.248901 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.249043 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.249185 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.249352 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.249507 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.249650 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.249799 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.249959 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.250101 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.250244 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.250384 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.250570 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.250728 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.250871 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.251161 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.251308 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.251456 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.251606 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.251801 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.251966 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.252118 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.252260 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.252412 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.252561 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.252726 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.252894 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.253069 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.253224 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.253367 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.253517 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.253659 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.253812 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.253953 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.254143 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.254290 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.254441 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.254616 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.254759 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.254898 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.255040 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.255215 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.255364 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.255506 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.255645 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.255924 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.256186 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.256418 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.256563 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.256704 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.256846 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.256993 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.257134 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.257282 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.257425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.257565 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.257705 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.257857 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.258006 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.258148 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.258301 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.258450 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.258647 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.258814 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.258943 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.259043 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.259219 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.259324 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.259482 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.259644 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.259784 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.259974 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.260088 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.260303 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.260399 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.260615 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.260704 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.260925 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.261011 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.261232 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.261318 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.261544 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.261632 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.261849 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.261935 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.262151 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.262237 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.262453 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.262573 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.262778 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.262877 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.263080 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.263175 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.263384 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.263486 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.263696 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.263796 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.264003 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.264100 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.264314 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.264401 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.264623 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.264709 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.264925 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.265019 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.265233 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.265319 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.265539 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.265632 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.265844 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.265940 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.266147 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.266234 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.266452 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.266559 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.266787 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.266888 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.267095 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.267182 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.267401 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.267543 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.267719 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.267809 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.268006 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.268100 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.268312 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.268399 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.268784 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.269236 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.269344 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.269428 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.269428 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.269580 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.269707 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.269873 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.270019 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.270161 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.270331 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.270516 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.270667 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.270808 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.270972 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.271121 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.271284 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.271444 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.271586 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.271737 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.271901 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.272050 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.272191 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.272345 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.272488 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.272628 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.272793 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.272949 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.273092 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.273241 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.273383 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.273535 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.273675 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.273816 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.273970 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.274111 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.274291 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.274446 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.274637 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.274780 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.274929 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.275071 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.275247 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.275396 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.275547 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.275696 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.275846 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.275988 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.276173 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.276322 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.276508 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.276663 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.276811 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.276957 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.277139 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.277287 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.277438 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.277587 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.277749 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.277905 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.278047 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.278208 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.278357 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.278540 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.278690 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 12:47:12.278832 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.278982 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.279281 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.279597 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.279913 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.280242 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.280569 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.280882 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.281208 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.281535 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.281882 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.282198 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.282567 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.282901 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.283217 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.283533 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.283840 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:47:12.284091 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 12:47:12.432189 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO dbcounter [None req-8acb71f4-d9ee-4701-a8e0-e1ac8d1a981e None None] Registered counter for database nova_api Sep 09 12:47:12.437138 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO dbcounter [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] Registered counter for database nova_api Sep 09 12:47:12.453040 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG oslo_db.sqlalchemy.engines [None req-8acb71f4-d9ee-4701-a8e0-e1ac8d1a981e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:47:12.457686 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_db.sqlalchemy.engines [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:47:12.460168 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG dbcounter [-] [112332] Writer thread running {{(pid=112332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:47:12.464149 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writer thread running {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:47:12.523986 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.context [None req-8acb71f4-d9ee-4701-a8e0-e1ac8d1a981e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5b125c4-b69c-4216-8126-4e61782bc3cb(cell1) {{(pid=112332) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 12:47:12.525421 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.context [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5b125c4-b69c-4216-8126-4e61782bc3cb(cell1) {{(pid=112333) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 12:47:12.527952 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG oslo_concurrency.lockutils [None req-8acb71f4-d9ee-4701-a8e0-e1ac8d1a981e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:47:12.528421 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG oslo_concurrency.lockutils [None req-8acb71f4-d9ee-4701-a8e0-e1ac8d1a981e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:47:12.529268 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:47:12.529739 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:47:12.529970 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG oslo_concurrency.lockutils [None req-8acb71f4-d9ee-4701-a8e0-e1ac8d1a981e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:47:12.530728 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG oslo_concurrency.lockutils [None req-8acb71f4-d9ee-4701-a8e0-e1ac8d1a981e None None] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:47:12.531152 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG oslo_concurrency.lockutils [None req-8acb71f4-d9ee-4701-a8e0-e1ac8d1a981e None None] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:47:12.531326 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:47:12.532035 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:47:12.532484 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:47:12.533130 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG oslo_concurrency.lockutils [None req-8acb71f4-d9ee-4701-a8e0-e1ac8d1a981e None None] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:47:12.535297 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:47:12.535721 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO dbcounter [None req-8acb71f4-d9ee-4701-a8e0-e1ac8d1a981e None None] Registered counter for database nova_cell0 Sep 09 12:47:12.537057 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO dbcounter [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] Registered counter for database nova_cell0 Sep 09 12:47:12.539711 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO dbcounter [None req-8acb71f4-d9ee-4701-a8e0-e1ac8d1a981e None None] Registered counter for database nova_cell1 Sep 09 12:47:12.541147 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO dbcounter [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] Registered counter for database nova_cell1 Sep 09 12:47:12.546993 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG oslo_db.sqlalchemy.engines [None req-8acb71f4-d9ee-4701-a8e0-e1ac8d1a981e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:47:12.548313 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG oslo_db.sqlalchemy.engines [None req-8acb71f4-d9ee-4701-a8e0-e1ac8d1a981e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:47:12.551956 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_db.sqlalchemy.engines [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:47:12.553123 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_db.sqlalchemy.engines [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:47:12.555647 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG dbcounter [-] [112332] Writer thread running {{(pid=112332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:47:12.557093 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG dbcounter [-] [112332] Writer thread running {{(pid=112332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:47:12.559852 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writer thread running {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:47:12.562041 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writer thread running {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:47:12.697467 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO dbcounter [None req-8acb71f4-d9ee-4701-a8e0-e1ac8d1a981e None None] Registered counter for database nova_cell0 Sep 09 12:47:12.703578 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO dbcounter [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] Registered counter for database nova_cell0 Sep 09 12:47:12.706205 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG oslo_db.sqlalchemy.engines [None req-8acb71f4-d9ee-4701-a8e0-e1ac8d1a981e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:47:12.711154 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG dbcounter [-] [112332] Writer thread running {{(pid=112332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:47:12.712583 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_db.sqlalchemy.engines [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:47:12.716864 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writer thread running {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:47:13.135937 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: WARNING keystonemiddleware.auth_token [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 12:47:13.143336 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: WARNING keystonemiddleware.auth_token [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 12:47:13.150803 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: WARNING keystonemiddleware.auth_token [None req-8acb71f4-d9ee-4701-a8e0-e1ac8d1a981e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 12:47:13.158047 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: WARNING keystonemiddleware.auth_token [None req-8acb71f4-d9ee-4701-a8e0-e1ac8d1a981e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 12:47:13.486870 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: WARNING keystonemiddleware.auth_token [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 12:47:13.493020 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: WARNING keystonemiddleware.auth_token [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 12:47:13.498231 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558622ab69c0 pid: 112333 (default app) Sep 09 12:47:13.500517 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:47:13.501692 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001936 Sep 09 12:47:13.502104 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Fri Sep 9 12:47:13 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:47:13.507583 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: WARNING keystonemiddleware.auth_token [None req-8acb71f4-d9ee-4701-a8e0-e1ac8d1a981e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 12:47:13.513544 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: WARNING keystonemiddleware.auth_token [None req-8acb71f4-d9ee-4701-a8e0-e1ac8d1a981e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 12:47:13.519966 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558622ab69c0 pid: 112332 (default app) Sep 09 12:48:38.170019 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:48:38.173573 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 09 12:48:38.173573 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 12:48:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:48:38.188383 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG dbcounter [-] [112332] Writing DB stats nova_api:SELECT=3 {{(pid=112332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:48:38.190849 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG dbcounter [-] [112332] Writing DB stats nova_cell1:SELECT=3 {{(pid=112332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:48:38.192006 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG dbcounter [-] [112332] Writing DB stats nova_cell0:SELECT=3 {{(pid=112332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:48:38.192834 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG dbcounter [-] [112332] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:48:39.086207 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-dc00cb2e-e2da-4a63-9b8d-2dd5b83a6d45 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:48:39.120406 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-dc00cb2e-e2da-4a63-9b8d-2dd5b83a6d45 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.940792 Sep 09 12:48:39.120406 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1292 bytes} [Fri Sep 9 12:48:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:48:41.794134 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:48:41.795174 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-06e6a74d-77b1-4533-ad1a-7db2e3b8b162 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Sep 09 12:48:41.795739 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 12:48:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:48:42.270627 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-aa9854c1-ec1d-4832-bcef-1af9d6b47b24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "id": "c1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "swap": 0, "ram": 256}} {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:48:42.373729 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-aa9854c1-ec1d-4832-bcef-1af9d6b47b24 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.570985 Sep 09 12:48:42.374289 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1283 bytes} [Fri Sep 9 12:48:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:48:42.388412 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writing DB stats nova_api:SELECT=3 {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:48:42.389227 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writing DB stats nova_cell0:SELECT=3 {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:48:42.391184 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writing DB stats nova_cell1:SELECT=3 {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:48:42.391943 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:48:42.600008 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-7f3e237c-44fb-4321-9d40-a6c83e0df69f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:48:42.705095 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-7f3e237c-44fb-4321-9d40-a6c83e0df69f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.321106 Sep 09 12:48:42.705659 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1336 bytes} [Fri Sep 9 12:48:42 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:48:45.362456 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-aa9854c1-ec1d-4832-bcef-1af9d6b47b24 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:48:45.364117 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-aa9854c1-ec1d-4832-bcef-1af9d6b47b24 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002099 Sep 09 12:48:45.364533 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 12:48:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:48:46.067283 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-6c816b3b-e4a7-4fab-9e85-9e5cbca0f727 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "ds512M", "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "id": "d1", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:48:46.186141 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-6c816b3b-e4a7-4fab-9e85-9e5cbca0f727 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.815349 Sep 09 12:48:46.186843 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1283 bytes} [Fri Sep 9 12:48:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:48:46.199960 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-ba99c1ae-c810-4487-b3c3-d206616b899c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:48:46.289469 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-ba99c1ae-c810-4487-b3c3-d206616b899c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093507 Sep 09 12:48:46.290094 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1336 bytes} [Fri Sep 9 12:48:46 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:48:48.881612 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-6c816b3b-e4a7-4fab-9e85-9e5cbca0f727 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:48:48.882753 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-6c816b3b-e4a7-4fab-9e85-9e5cbca0f727 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 09 12:48:48.883153 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 12:48:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:48:49.310703 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-74db5ce7-3950-48db-992f-64abf352330f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 1024, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "name": "ds1G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:48:49.387463 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-74db5ce7-3950-48db-992f-64abf352330f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.497695 Sep 09 12:48:49.388205 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1283 bytes} [Fri Sep 9 12:48:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:48:49.400097 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-4ea72057-3e01-4f05-bc74-cb2bc8e992d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:48:49.511239 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-4ea72057-3e01-4f05-bc74-cb2bc8e992d6 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114756 Sep 09 12:48:49.511829 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1336 bytes} [Fri Sep 9 12:48:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:48:52.171936 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-74db5ce7-3950-48db-992f-64abf352330f admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:48:52.174268 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-74db5ce7-3950-48db-992f-64abf352330f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002709 Sep 09 12:48:52.174877 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 12:48:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:48:52.616477 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-cb5c832b-2755-4f9e-a4c1-0466b2efa9eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "swap": 0, "disk": 10, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:48:52.689766 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-cb5c832b-2755-4f9e-a4c1-0466b2efa9eb admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.508894 Sep 09 12:48:52.690509 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1283 bytes} [Fri Sep 9 12:48:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:48:52.702794 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-583f7175-6afe-41db-9a81-89004e0a615a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:48:52.791411 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-583f7175-6afe-41db-9a81-89004e0a615a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092139 Sep 09 12:48:52.792461 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1336 bytes} [Fri Sep 9 12:48:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:48:55.487198 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-cb5c832b-2755-4f9e-a4c1-0466b2efa9eb admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:48:55.488212 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-cb5c832b-2755-4f9e-a4c1-0466b2efa9eb admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 09 12:48:55.488613 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 12:48:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:48:55.913133 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-5502248f-75f3-4a17-a63d-af4853560721 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "name": "ds4G"}} {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:48:55.997405 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-5502248f-75f3-4a17-a63d-af4853560721 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.501214 Sep 09 12:48:55.998113 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1283 bytes} [Fri Sep 9 12:48:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:48:56.012023 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-bb034c47-f39e-4ad3-b1cb-a1fb53f090c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:48:56.100247 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-bb034c47-f39e-4ad3-b1cb-a1fb53f090c0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092366 Sep 09 12:48:56.101089 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1336 bytes} [Fri Sep 9 12:48:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:48:59.310086 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-5502248f-75f3-4a17-a63d-af4853560721 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:48:59.311154 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-5502248f-75f3-4a17-a63d-af4853560721 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Sep 09 12:48:59.311625 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 12:48:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:48:59.747391 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-7e8a6efe-82d0-4e6a-8d7c-87b222a83770 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:48:59.778234 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-7e8a6efe-82d0-4e6a-8d7c-87b222a83770 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.459216 Sep 09 12:48:59.778921 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1292 bytes} [Fri Sep 9 12:48:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:49:02.424038 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-5502248f-75f3-4a17-a63d-af4853560721 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:02.425060 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-5502248f-75f3-4a17-a63d-af4853560721 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 09 12:49:02.425471 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 12:49:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:49:02.820553 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-9405e3ee-bb66-4129-9534-aa061e43b321 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "ram": 512, "swap": 0, "id": "1", "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:49:02.910249 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-9405e3ee-bb66-4129-9534-aa061e43b321 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.478508 Sep 09 12:49:02.910889 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1283 bytes} [Fri Sep 9 12:49:02 2022] POST /compute/v2.1/flavors => generated 402 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:49:02.925974 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-356ba9bf-a928-45f3-b191-4d52abb86288 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:49:03.025293 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-356ba9bf-a928-45f3-b191-4d52abb86288 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103729 Sep 09 12:49:03.025908 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1333 bytes} [Fri Sep 9 12:49:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:49:05.677224 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-9405e3ee-bb66-4129-9534-aa061e43b321 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:05.678219 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-9405e3ee-bb66-4129-9534-aa061e43b321 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Sep 09 12:49:05.678644 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 12:49:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:49:06.032286 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-6e015164-3e2c-4698-99f5-b45f12f282aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "vcpus": 1, "ram": 2048, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:49:06.105246 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-6e015164-3e2c-4698-99f5-b45f12f282aa admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.420284 Sep 09 12:49:06.105801 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1283 bytes} [Fri Sep 9 12:49:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:49:06.118323 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-04522563-903c-4528-994a-a59e58cefe9f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:49:06.193965 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-04522563-903c-4528-994a-a59e58cefe9f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079321 Sep 09 12:49:06.194552 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1333 bytes} [Fri Sep 9 12:49:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:49:08.870129 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-6e015164-3e2c-4698-99f5-b45f12f282aa admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:08.871108 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-6e015164-3e2c-4698-99f5-b45f12f282aa admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 09 12:49:08.871510 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 12:49:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:49:09.316636 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-4725459a-2453-4ea8-9f35-0c0765b5ff25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "swap": 0, "id": "3", "disk": 40, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:49:09.398264 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-4725459a-2453-4ea8-9f35-0c0765b5ff25 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.520118 Sep 09 12:49:09.399778 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1283 bytes} [Fri Sep 9 12:49:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:49:09.411438 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-a78f3763-403a-4182-9929-b01ca8f12d42 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:49:09.417474 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG dbcounter [-] [112332] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:49:09.527536 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-a78f3763-403a-4182-9929-b01ca8f12d42 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116225 Sep 09 12:49:09.528177 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1333 bytes} [Fri Sep 9 12:49:09 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:49:12.194680 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-4725459a-2453-4ea8-9f35-0c0765b5ff25 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:12.195695 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-4725459a-2453-4ea8-9f35-0c0765b5ff25 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 09 12:49:12.196096 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 12:49:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:49:12.646615 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-b756d378-ad0c-40ae-9b79-7cf9f1921af9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "4", "disk": 80, "name": "m1.large", "ram": 8192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0}} {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:49:12.760661 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-b756d378-ad0c-40ae-9b79-7cf9f1921af9 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.558012 Sep 09 12:49:12.761212 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1283 bytes} [Fri Sep 9 12:49:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 12:49:12.780124 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-cc5e3b30-9489-4c71-8e26-1f4d27b0e35c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:49:12.785961 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:49:12.894316 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-cc5e3b30-9489-4c71-8e26-1f4d27b0e35c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118878 Sep 09 12:49:12.895149 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1333 bytes} [Fri Sep 9 12:49:12 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:49:15.548345 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-b756d378-ad0c-40ae-9b79-7cf9f1921af9 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:15.549362 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-b756d378-ad0c-40ae-9b79-7cf9f1921af9 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001631 Sep 09 12:49:15.549756 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 12:49:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:49:15.983099 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-12af605f-4241-4d79-ab9a-8655225668c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "os-flavor-access:is_public": true, "swap": 0, "ram": 16384, "vcpus": 8, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "rxtx_factor": 1.0}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:49:16.103168 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-12af605f-4241-4d79-ab9a-8655225668c2 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.547210 Sep 09 12:49:16.111673 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1283 bytes} [Fri Sep 9 12:49:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:49:16.117327 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-df62b097-bec5-476c-8b3c-0134a7fb2f8f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:49:16.196505 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-df62b097-bec5-476c-8b3c-0134a7fb2f8f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083397 Sep 09 12:49:16.197091 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1333 bytes} [Fri Sep 9 12:49:16 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:49:33.255416 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-12af605f-4241-4d79-ab9a-8655225668c2 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:33.256476 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-12af605f-4241-4d79-ab9a-8655225668c2 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Sep 09 12:49:33.256919 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 12:49:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:49:33.268151 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG dbcounter [-] [112332] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:49:33.651031 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-d7404699-ac8e-4420-911d-b75c04a3687b admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:33.668943 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-d7404699-ac8e-4420-911d-b75c04a3687b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405818 Sep 09 12:49:33.669476 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1292 bytes} [Fri Sep 9 12:49:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:49:34.970852 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-12af605f-4241-4d79-ab9a-8655225668c2 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:34.971861 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-12af605f-4241-4d79-ab9a-8655225668c2 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002121 Sep 09 12:49:34.972255 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 12:49:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:49:35.503590 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-3dd35b5b-58b6-4faf-8d22-5c62c9a739e5 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:35.509073 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.wsgi [None req-3dd35b5b-58b6-4faf-8d22-5c62c9a739e5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 12:49:35.512425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-3dd35b5b-58b6-4faf-8d22-5c62c9a739e5 admin admin] Request method failure captured: Sep 09 12:49:35.512425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 12:49:35.512425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Accept: application/json Sep 09 12:49:35.512425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Accept-Encoding: gzip, deflate Sep 09 12:49:35.512425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Connection: keep-alive Sep 09 12:49:35.512425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Content-Length: 0 Sep 09 12:49:35.512425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Host: 10.222.0.46 Sep 09 12:49:35.512425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Openstack-Api-Version: compute 2.92 Sep 09 12:49:35.512425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Openstack-System-Scope: None Sep 09 12:49:35.512425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: User-Agent: python-novaclient Sep 09 12:49:35.512425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Auth-Token: gAAAAABjGzZeEti-ybZkr_L5BYZc7HmPm2D16xg72viPcOxoITz0iyqzyAJ19nvIYUZcA7QA1bT9CfjmWOgVFBPcnShfxt9cnarrKlGlVL3SF1nZkGXiao77Z28NMEAQBe0sizq-fTEcEztLBi8pbnrjiOy95VRareUY2SdaUzBlaQzKTRPEOyo Sep 09 12:49:35.512425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Domain-Id: None Sep 09 12:49:35.512425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Domain-Name: None Sep 09 12:49:35.512425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Identity-Status: Confirmed Sep 09 12:49:35.512425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Is-Admin-Project: True Sep 09 12:49:35.512425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 12:49:35.512425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Project-Domain-Id: default Sep 09 12:49:35.512425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Project-Domain-Name: Default Sep 09 12:49:35.512425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Project-Id: e314473e6b1442dfa9c0bcc6fc5f97c6 Sep 09 12:49:35.512425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Project-Name: admin Sep 09 12:49:35.512425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Role: member,admin,reader Sep 09 12:49:35.512425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Roles: member,admin,reader Sep 09 12:49:35.514124 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e314473e6b1442dfa9c0bcc6fc5f97c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e314473e6b1442dfa9c0bcc6fc5f97c6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e314473e6b1442dfa9c0bcc6fc5f97c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e314473e6b1442dfa9c0bcc6fc5f97c6"}]}] Sep 09 12:49:35.514124 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Tenant: admin Sep 09 12:49:35.514124 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Tenant-Id: e314473e6b1442dfa9c0bcc6fc5f97c6 Sep 09 12:49:35.514124 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Tenant-Name: admin Sep 09 12:49:35.514124 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-User: admin Sep 09 12:49:35.514124 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-User-Domain-Id: default Sep 09 12:49:35.514124 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-User-Domain-Name: Default Sep 09 12:49:35.514124 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-User-Id: 9947df19bb3b44318e674b5168544c18 Sep 09 12:49:35.514124 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-User-Name: admin Sep 09 12:49:35.514124 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: method: > Sep 09 12:49:35.514124 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: exception: Flavor 42 could not be found. Sep 09 12:49:35.514124 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: action_args: {'id': '42'} Sep 09 12:49:35.514124 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:49:35.514124 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:49:35.515413 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 12:49:35.515413 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 12:49:35.515413 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 12:49:35.515413 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 12:49:35.515413 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 12:49:35.515413 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 12:49:35.515413 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 12:49:35.515413 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 12:49:35.515413 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 12:49:35.515413 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:49:35.515413 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 12:49:35.515413 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 12:49:35.515413 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 12:49:35.515413 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Sep 09 12:49:35.515413 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:49:35.515413 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Sep 09 12:49:35.515413 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:49:35.515413 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:49:35.515413 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:49:35.517276 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:49:35.517276 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:49:35.517276 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:49:35.517276 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:49:35.517276 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 12:49:35.517276 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:49:35.517276 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 12:49:35.517276 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Sep 09 12:49:35.517276 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:49:35.517276 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Sep 09 12:49:35.517276 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:49:35.517276 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:49:35.517276 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:49:35.517276 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:49:35.517276 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:49:35.517276 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 12:49:35.517276 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Sep 09 12:49:35.517276 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-3dd35b5b-58b6-4faf-8d22-5c62c9a739e5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:49:35.518571 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-3dd35b5b-58b6-4faf-8d22-5c62c9a739e5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.397121 Sep 09 12:49:35.518571 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Fri Sep 9 12:49:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 12:49:35.524912 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-de665597-c295-4e9a-a575-d41de207d7c3 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:35.529251 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:49:35.549278 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-de665597-c295-4e9a-a575-d41de207d7c3 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028199 Sep 09 12:49:35.549843 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Sep 9 12:49:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:49:35.560433 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-3fcf0798-283e-41e8-ba1d-99a4f7b78268 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:35.583203 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-3fcf0798-283e-41e8-ba1d-99a4f7b78268 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027165 Sep 09 12:49:35.583750 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Sep 9 12:49:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:49:35.593516 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-4363d63b-e3b1-47c6-a903-9c8a187b3999 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:35.600052 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.wsgi [None req-4363d63b-e3b1-47c6-a903-9c8a187b3999 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 12:49:35.603362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-4363d63b-e3b1-47c6-a903-9c8a187b3999 admin admin] Request method failure captured: Sep 09 12:49:35.603362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 12:49:35.603362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Accept: application/json Sep 09 12:49:35.603362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Accept-Encoding: gzip, deflate Sep 09 12:49:35.603362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Connection: keep-alive Sep 09 12:49:35.603362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Content-Length: 0 Sep 09 12:49:35.603362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Host: 10.222.0.46 Sep 09 12:49:35.603362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Openstack-Api-Version: compute 2.92 Sep 09 12:49:35.603362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Openstack-System-Scope: None Sep 09 12:49:35.603362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: User-Agent: python-novaclient Sep 09 12:49:35.603362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Auth-Token: gAAAAABjGzZeEti-ybZkr_L5BYZc7HmPm2D16xg72viPcOxoITz0iyqzyAJ19nvIYUZcA7QA1bT9CfjmWOgVFBPcnShfxt9cnarrKlGlVL3SF1nZkGXiao77Z28NMEAQBe0sizq-fTEcEztLBi8pbnrjiOy95VRareUY2SdaUzBlaQzKTRPEOyo Sep 09 12:49:35.603362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Domain-Id: None Sep 09 12:49:35.603362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Domain-Name: None Sep 09 12:49:35.603362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Identity-Status: Confirmed Sep 09 12:49:35.603362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Is-Admin-Project: True Sep 09 12:49:35.603362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 12:49:35.603362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Project-Domain-Id: default Sep 09 12:49:35.603362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Project-Domain-Name: Default Sep 09 12:49:35.603362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Project-Id: e314473e6b1442dfa9c0bcc6fc5f97c6 Sep 09 12:49:35.603362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Project-Name: admin Sep 09 12:49:35.603362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Role: member,admin,reader Sep 09 12:49:35.603362 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Roles: member,admin,reader Sep 09 12:49:35.604934 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e314473e6b1442dfa9c0bcc6fc5f97c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e314473e6b1442dfa9c0bcc6fc5f97c6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e314473e6b1442dfa9c0bcc6fc5f97c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e314473e6b1442dfa9c0bcc6fc5f97c6"}]}] Sep 09 12:49:35.604934 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Tenant: admin Sep 09 12:49:35.604934 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Tenant-Id: e314473e6b1442dfa9c0bcc6fc5f97c6 Sep 09 12:49:35.604934 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Tenant-Name: admin Sep 09 12:49:35.604934 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-User: admin Sep 09 12:49:35.604934 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-User-Domain-Id: default Sep 09 12:49:35.604934 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-User-Domain-Name: Default Sep 09 12:49:35.604934 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-User-Id: 9947df19bb3b44318e674b5168544c18 Sep 09 12:49:35.604934 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-User-Name: admin Sep 09 12:49:35.604934 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: method: > Sep 09 12:49:35.604934 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: exception: Flavor 42 could not be found. Sep 09 12:49:35.604934 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: action_args: {'id': '42'} Sep 09 12:49:35.604934 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:49:35.604934 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:49:35.605883 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 12:49:35.605883 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 12:49:35.605883 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 12:49:35.605883 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 12:49:35.605883 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 12:49:35.605883 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 12:49:35.605883 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 12:49:35.605883 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 12:49:35.605883 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 12:49:35.605883 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:49:35.605883 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 12:49:35.605883 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 12:49:35.605883 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 12:49:35.605883 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Sep 09 12:49:35.605883 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:49:35.605883 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Sep 09 12:49:35.605883 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:49:35.605883 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:49:35.605883 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:49:35.610809 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:49:35.610809 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:49:35.610809 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:49:35.610809 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:49:35.610809 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 12:49:35.610809 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:49:35.610809 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 12:49:35.610809 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Sep 09 12:49:35.610809 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:49:35.610809 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Sep 09 12:49:35.610809 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:49:35.610809 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:49:35.610809 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:49:35.610809 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:49:35.610809 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:49:35.610809 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 12:49:35.610809 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Sep 09 12:49:35.610809 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-4363d63b-e3b1-47c6-a903-9c8a187b3999 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:49:35.612043 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-4363d63b-e3b1-47c6-a903-9c8a187b3999 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015163 Sep 09 12:49:35.612043 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Fri Sep 9 12:49:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 12:49:36.826226 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-3fcf0798-283e-41e8-ba1d-99a4f7b78268 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:36.827285 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-3fcf0798-283e-41e8-ba1d-99a4f7b78268 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 09 12:49:36.827686 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 12:49:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:49:37.345919 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-ad25d484-67f0-4331-a240-c95029bf2249 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:37.350967 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.wsgi [None req-ad25d484-67f0-4331-a240-c95029bf2249 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 12:49:37.352454 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-ad25d484-67f0-4331-a240-c95029bf2249 admin admin] Request method failure captured: Sep 09 12:49:37.352454 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 12:49:37.352454 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Accept: application/json Sep 09 12:49:37.352454 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Accept-Encoding: gzip, deflate Sep 09 12:49:37.352454 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Connection: keep-alive Sep 09 12:49:37.352454 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Content-Length: 0 Sep 09 12:49:37.352454 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Host: 10.222.0.46 Sep 09 12:49:37.352454 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Openstack-Api-Version: compute 2.92 Sep 09 12:49:37.352454 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Openstack-System-Scope: None Sep 09 12:49:37.352454 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: User-Agent: python-novaclient Sep 09 12:49:37.352454 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Auth-Token: gAAAAABjGzZgg1ZNqcR2x1GxGNycHy_CA30CKRRw_oFn_1LravUa8ZJZ7Ubjf-qM13yyqTvMRMM3BSBdK73AdkRVe1O2mBCvT_vaHkcxyp_p-5vsEX8j6As7Avzzr24QsEiVxw8xC09hWevRTls-LuWC0DBN2PNqaCDKcw9Et8BeES19IBTeolU Sep 09 12:49:37.352454 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Domain-Id: None Sep 09 12:49:37.352454 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Domain-Name: None Sep 09 12:49:37.352454 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Identity-Status: Confirmed Sep 09 12:49:37.352454 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Is-Admin-Project: True Sep 09 12:49:37.352454 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 12:49:37.352454 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Project-Domain-Id: default Sep 09 12:49:37.352454 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Project-Domain-Name: Default Sep 09 12:49:37.352454 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Project-Id: e314473e6b1442dfa9c0bcc6fc5f97c6 Sep 09 12:49:37.352454 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Project-Name: admin Sep 09 12:49:37.352454 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Role: member,admin,reader Sep 09 12:49:37.352454 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Roles: member,admin,reader Sep 09 12:49:37.353935 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e314473e6b1442dfa9c0bcc6fc5f97c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e314473e6b1442dfa9c0bcc6fc5f97c6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e314473e6b1442dfa9c0bcc6fc5f97c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e314473e6b1442dfa9c0bcc6fc5f97c6"}]}] Sep 09 12:49:37.353935 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Tenant: admin Sep 09 12:49:37.353935 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Tenant-Id: e314473e6b1442dfa9c0bcc6fc5f97c6 Sep 09 12:49:37.353935 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Tenant-Name: admin Sep 09 12:49:37.353935 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-User: admin Sep 09 12:49:37.353935 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-User-Domain-Id: default Sep 09 12:49:37.353935 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-User-Domain-Name: Default Sep 09 12:49:37.353935 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-User-Id: 9947df19bb3b44318e674b5168544c18 Sep 09 12:49:37.353935 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-User-Name: admin Sep 09 12:49:37.353935 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: method: > Sep 09 12:49:37.353935 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: exception: Flavor 84 could not be found. Sep 09 12:49:37.353935 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: action_args: {'id': '84'} Sep 09 12:49:37.353935 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:49:37.353935 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:49:37.354997 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 12:49:37.354997 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 12:49:37.354997 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 12:49:37.354997 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 12:49:37.354997 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 12:49:37.354997 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 12:49:37.354997 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 12:49:37.354997 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 12:49:37.354997 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 12:49:37.354997 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:49:37.354997 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 12:49:37.354997 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 12:49:37.354997 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 12:49:37.354997 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Sep 09 12:49:37.354997 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:49:37.354997 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Sep 09 12:49:37.354997 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:49:37.354997 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:49:37.354997 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:49:37.356370 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:49:37.356370 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:49:37.356370 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:49:37.356370 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:49:37.356370 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 12:49:37.356370 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:49:37.356370 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 12:49:37.356370 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Sep 09 12:49:37.356370 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:49:37.356370 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Sep 09 12:49:37.356370 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:49:37.356370 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:49:37.356370 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:49:37.356370 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:49:37.356370 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:49:37.356370 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 12:49:37.356370 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Sep 09 12:49:37.356370 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-ad25d484-67f0-4331-a240-c95029bf2249 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:49:37.357590 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-ad25d484-67f0-4331-a240-c95029bf2249 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.389459 Sep 09 12:49:37.357590 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Fri Sep 9 12:49:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 12:49:37.363600 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-02bba2ac-c521-493e-b068-cc177c7fca5b admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:37.378956 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-02bba2ac-c521-493e-b068-cc177c7fca5b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018947 Sep 09 12:49:37.379693 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Sep 9 12:49:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:49:37.388680 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-ffd37796-8ccd-4953-9584-c90d06769a1a admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:37.404461 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-ffd37796-8ccd-4953-9584-c90d06769a1a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019243 Sep 09 12:49:37.404970 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Sep 9 12:49:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:49:37.413874 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-c90c1b74-0645-4957-a29d-f857832b1889 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:37.418748 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.wsgi [None req-c90c1b74-0645-4957-a29d-f857832b1889 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 12:49:37.420263 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-c90c1b74-0645-4957-a29d-f857832b1889 admin admin] Request method failure captured: Sep 09 12:49:37.420263 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 12:49:37.420263 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Accept: application/json Sep 09 12:49:37.420263 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Accept-Encoding: gzip, deflate Sep 09 12:49:37.420263 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Connection: keep-alive Sep 09 12:49:37.420263 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Content-Length: 0 Sep 09 12:49:37.420263 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Host: 10.222.0.46 Sep 09 12:49:37.420263 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Openstack-Api-Version: compute 2.92 Sep 09 12:49:37.420263 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Openstack-System-Scope: None Sep 09 12:49:37.420263 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: User-Agent: python-novaclient Sep 09 12:49:37.420263 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Auth-Token: gAAAAABjGzZgg1ZNqcR2x1GxGNycHy_CA30CKRRw_oFn_1LravUa8ZJZ7Ubjf-qM13yyqTvMRMM3BSBdK73AdkRVe1O2mBCvT_vaHkcxyp_p-5vsEX8j6As7Avzzr24QsEiVxw8xC09hWevRTls-LuWC0DBN2PNqaCDKcw9Et8BeES19IBTeolU Sep 09 12:49:37.420263 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Domain-Id: None Sep 09 12:49:37.420263 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Domain-Name: None Sep 09 12:49:37.420263 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Identity-Status: Confirmed Sep 09 12:49:37.420263 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Is-Admin-Project: True Sep 09 12:49:37.420263 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 12:49:37.420263 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Project-Domain-Id: default Sep 09 12:49:37.420263 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Project-Domain-Name: Default Sep 09 12:49:37.420263 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Project-Id: e314473e6b1442dfa9c0bcc6fc5f97c6 Sep 09 12:49:37.420263 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Project-Name: admin Sep 09 12:49:37.420263 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Role: member,admin,reader Sep 09 12:49:37.420263 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Roles: member,admin,reader Sep 09 12:49:37.421880 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e314473e6b1442dfa9c0bcc6fc5f97c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e314473e6b1442dfa9c0bcc6fc5f97c6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e314473e6b1442dfa9c0bcc6fc5f97c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e314473e6b1442dfa9c0bcc6fc5f97c6"}]}] Sep 09 12:49:37.421880 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Tenant: admin Sep 09 12:49:37.421880 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Tenant-Id: e314473e6b1442dfa9c0bcc6fc5f97c6 Sep 09 12:49:37.421880 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Tenant-Name: admin Sep 09 12:49:37.421880 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-User: admin Sep 09 12:49:37.421880 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-User-Domain-Id: default Sep 09 12:49:37.421880 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-User-Domain-Name: Default Sep 09 12:49:37.421880 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-User-Id: 9947df19bb3b44318e674b5168544c18 Sep 09 12:49:37.421880 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-User-Name: admin Sep 09 12:49:37.421880 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: method: > Sep 09 12:49:37.421880 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: exception: Flavor 84 could not be found. Sep 09 12:49:37.421880 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: action_args: {'id': '84'} Sep 09 12:49:37.421880 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:49:37.421880 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:49:37.422842 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 12:49:37.422842 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 12:49:37.422842 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 12:49:37.422842 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 12:49:37.422842 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 12:49:37.422842 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 12:49:37.422842 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 12:49:37.422842 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 12:49:37.422842 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 12:49:37.422842 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:49:37.422842 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 12:49:37.422842 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 12:49:37.422842 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 12:49:37.422842 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Sep 09 12:49:37.422842 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:49:37.422842 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Sep 09 12:49:37.422842 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:49:37.422842 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:49:37.422842 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:49:37.424086 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:49:37.424086 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:49:37.424086 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:49:37.424086 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:49:37.424086 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 12:49:37.424086 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:49:37.424086 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 12:49:37.424086 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Sep 09 12:49:37.424086 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:49:37.424086 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Sep 09 12:49:37.424086 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:49:37.424086 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:49:37.424086 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:49:37.424086 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:49:37.424086 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:49:37.424086 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 12:49:37.424086 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Sep 09 12:49:37.424086 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-c90c1b74-0645-4957-a29d-f857832b1889 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:49:37.425089 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-c90c1b74-0645-4957-a29d-f857832b1889 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011146 Sep 09 12:49:37.425089 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Fri Sep 9 12:49:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 09 12:49:38.656795 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-ffd37796-8ccd-4953-9584-c90d06769a1a admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:38.657844 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-ffd37796-8ccd-4953-9584-c90d06769a1a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 09 12:49:38.658241 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 12:49:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:49:39.176699 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-fddb18b4-9f00-44b4-8ad2-8564133c4fa2 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:39.182358 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.wsgi [None req-fddb18b4-9f00-44b4-8ad2-8564133c4fa2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 12:49:39.183942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-fddb18b4-9f00-44b4-8ad2-8564133c4fa2 admin admin] Request method failure captured: Sep 09 12:49:39.183942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 12:49:39.183942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Accept: application/json Sep 09 12:49:39.183942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Accept-Encoding: gzip, deflate Sep 09 12:49:39.183942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Connection: keep-alive Sep 09 12:49:39.183942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Content-Length: 0 Sep 09 12:49:39.183942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Host: 10.222.0.46 Sep 09 12:49:39.183942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Openstack-Api-Version: compute 2.92 Sep 09 12:49:39.183942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Openstack-System-Scope: None Sep 09 12:49:39.183942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: User-Agent: python-novaclient Sep 09 12:49:39.183942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Auth-Token: gAAAAABjGzZiQkgGQdclJ-DmlVV1C0U3YBDFrsSIUlLx5f_xK0ntv0jEBcjLielZ2qnKs2DKdmj8qvtAM9AFcRWyy46tB2MJSEpp0Xds-Mnb693prhiN8EFSAW7m7HYO_gaRYUdCQlw8uCn9MvkKw2rV7JXlcsldAn8dwbrJWBAr8HLkhLTp5ig Sep 09 12:49:39.183942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Domain-Id: None Sep 09 12:49:39.183942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Domain-Name: None Sep 09 12:49:39.183942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Identity-Status: Confirmed Sep 09 12:49:39.183942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Is-Admin-Project: True Sep 09 12:49:39.183942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 12:49:39.183942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Project-Domain-Id: default Sep 09 12:49:39.183942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Project-Domain-Name: Default Sep 09 12:49:39.183942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Project-Id: e314473e6b1442dfa9c0bcc6fc5f97c6 Sep 09 12:49:39.183942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Project-Name: admin Sep 09 12:49:39.183942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Role: member,admin,reader Sep 09 12:49:39.183942 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Roles: member,admin,reader Sep 09 12:49:39.185514 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e314473e6b1442dfa9c0bcc6fc5f97c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e314473e6b1442dfa9c0bcc6fc5f97c6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e314473e6b1442dfa9c0bcc6fc5f97c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e314473e6b1442dfa9c0bcc6fc5f97c6"}]}] Sep 09 12:49:39.185514 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Tenant: admin Sep 09 12:49:39.185514 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Tenant-Id: e314473e6b1442dfa9c0bcc6fc5f97c6 Sep 09 12:49:39.185514 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-Tenant-Name: admin Sep 09 12:49:39.185514 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-User: admin Sep 09 12:49:39.185514 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-User-Domain-Id: default Sep 09 12:49:39.185514 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-User-Domain-Name: Default Sep 09 12:49:39.185514 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-User-Id: 9947df19bb3b44318e674b5168544c18 Sep 09 12:49:39.185514 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: X-User-Name: admin Sep 09 12:49:39.185514 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: method: > Sep 09 12:49:39.185514 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: exception: Flavor 451 could not be found. Sep 09 12:49:39.185514 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: action_args: {'id': '451'} Sep 09 12:49:39.185514 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:49:39.185514 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:49:39.186511 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 12:49:39.186511 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 12:49:39.186511 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 12:49:39.186511 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 12:49:39.186511 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 12:49:39.186511 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 12:49:39.186511 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 12:49:39.186511 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 12:49:39.186511 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 12:49:39.186511 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:49:39.186511 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 12:49:39.186511 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 12:49:39.186511 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 12:49:39.186511 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Sep 09 12:49:39.186511 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:49:39.186511 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Sep 09 12:49:39.186511 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:49:39.186511 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:49:39.186511 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:49:39.187876 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:49:39.187876 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:49:39.187876 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:49:39.187876 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:49:39.187876 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 12:49:39.187876 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:49:39.187876 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 12:49:39.187876 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Sep 09 12:49:39.187876 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:49:39.187876 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Sep 09 12:49:39.187876 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:49:39.187876 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:49:39.187876 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:49:39.187876 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:49:39.187876 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:49:39.187876 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 12:49:39.187876 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: ERROR nova.api.openstack.wsgi Sep 09 12:49:39.187876 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-fddb18b4-9f00-44b4-8ad2-8564133c4fa2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:49:39.190714 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-fddb18b4-9f00-44b4-8ad2-8564133c4fa2 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392300 Sep 09 12:49:39.190714 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Sep 9 12:49:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 12:49:39.196280 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-5e4e3343-4161-4549-ae5a-d9603e34c056 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:39.212191 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-5e4e3343-4161-4549-ae5a-d9603e34c056 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019404 Sep 09 12:49:39.212747 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Sep 9 12:49:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:49:39.224418 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-ea5dc046-092e-47ea-9a6f-f42770d8c0e7 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:39.240149 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-ea5dc046-092e-47ea-9a6f-f42770d8c0e7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019481 Sep 09 12:49:39.244725 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Sep 9 12:49:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:49:39.254001 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-6c2609d5-b0ab-4937-9dd9-07c4f41a6db8 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:39.259093 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.wsgi [None req-6c2609d5-b0ab-4937-9dd9-07c4f41a6db8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 12:49:39.260584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-6c2609d5-b0ab-4937-9dd9-07c4f41a6db8 admin admin] Request method failure captured: Sep 09 12:49:39.260584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 12:49:39.260584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Accept: application/json Sep 09 12:49:39.260584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Accept-Encoding: gzip, deflate Sep 09 12:49:39.260584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Connection: keep-alive Sep 09 12:49:39.260584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Content-Length: 0 Sep 09 12:49:39.260584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Host: 10.222.0.46 Sep 09 12:49:39.260584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Openstack-Api-Version: compute 2.92 Sep 09 12:49:39.260584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Openstack-System-Scope: None Sep 09 12:49:39.260584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: User-Agent: python-novaclient Sep 09 12:49:39.260584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Auth-Token: gAAAAABjGzZiQkgGQdclJ-DmlVV1C0U3YBDFrsSIUlLx5f_xK0ntv0jEBcjLielZ2qnKs2DKdmj8qvtAM9AFcRWyy46tB2MJSEpp0Xds-Mnb693prhiN8EFSAW7m7HYO_gaRYUdCQlw8uCn9MvkKw2rV7JXlcsldAn8dwbrJWBAr8HLkhLTp5ig Sep 09 12:49:39.260584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Domain-Id: None Sep 09 12:49:39.260584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Domain-Name: None Sep 09 12:49:39.260584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Identity-Status: Confirmed Sep 09 12:49:39.260584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Is-Admin-Project: True Sep 09 12:49:39.260584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 12:49:39.260584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Project-Domain-Id: default Sep 09 12:49:39.260584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Project-Domain-Name: Default Sep 09 12:49:39.260584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Project-Id: e314473e6b1442dfa9c0bcc6fc5f97c6 Sep 09 12:49:39.260584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Project-Name: admin Sep 09 12:49:39.260584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Role: member,admin,reader Sep 09 12:49:39.260584 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Roles: member,admin,reader Sep 09 12:49:39.262252 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e314473e6b1442dfa9c0bcc6fc5f97c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e314473e6b1442dfa9c0bcc6fc5f97c6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e314473e6b1442dfa9c0bcc6fc5f97c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e314473e6b1442dfa9c0bcc6fc5f97c6"}]}] Sep 09 12:49:39.262252 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Tenant: admin Sep 09 12:49:39.262252 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Tenant-Id: e314473e6b1442dfa9c0bcc6fc5f97c6 Sep 09 12:49:39.262252 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-Tenant-Name: admin Sep 09 12:49:39.262252 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-User: admin Sep 09 12:49:39.262252 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-User-Domain-Id: default Sep 09 12:49:39.262252 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-User-Domain-Name: Default Sep 09 12:49:39.262252 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-User-Id: 9947df19bb3b44318e674b5168544c18 Sep 09 12:49:39.262252 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: X-User-Name: admin Sep 09 12:49:39.262252 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: method: > Sep 09 12:49:39.262252 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: exception: Flavor 451 could not be found. Sep 09 12:49:39.262252 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: action_args: {'id': '451'} Sep 09 12:49:39.262252 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:49:39.262252 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:49:39.263143 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 12:49:39.263143 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 12:49:39.263143 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 12:49:39.263143 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 12:49:39.263143 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 12:49:39.263143 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 12:49:39.263143 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 12:49:39.263143 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 12:49:39.263143 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 12:49:39.263143 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:49:39.263143 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 12:49:39.263143 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 12:49:39.263143 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 12:49:39.263143 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Sep 09 12:49:39.263143 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:49:39.263143 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Sep 09 12:49:39.263143 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:49:39.263143 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:49:39.263143 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:49:39.264541 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:49:39.264541 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:49:39.264541 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:49:39.264541 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:49:39.264541 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 12:49:39.264541 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:49:39.264541 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 12:49:39.264541 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Sep 09 12:49:39.264541 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:49:39.264541 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Sep 09 12:49:39.264541 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:49:39.264541 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:49:39.264541 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:49:39.264541 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:49:39.264541 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:49:39.264541 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 12:49:39.264541 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Sep 09 12:49:39.264541 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-6c2609d5-b0ab-4937-9dd9-07c4f41a6db8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:49:39.265789 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-6c2609d5-b0ab-4937-9dd9-07c4f41a6db8 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012804 Sep 09 12:49:39.265789 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Sep 9 12:49:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 12:49:40.503218 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-ea5dc046-092e-47ea-9a6f-f42770d8c0e7 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:40.504232 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-ea5dc046-092e-47ea-9a6f-f42770d8c0e7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 09 12:49:40.504623 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 12:49:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:49:41.022768 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-ee866852-a49c-40d7-a722-e930e55c5bb2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:49:41.099453 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-ee866852-a49c-40d7-a722-e930e55c5bb2 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.457425 Sep 09 12:49:41.100005 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Fri Sep 9 12:49:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:49:42.310457 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-ea5dc046-092e-47ea-9a6f-f42770d8c0e7 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:42.311515 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-ea5dc046-092e-47ea-9a6f-f42770d8c0e7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Sep 09 12:49:42.311906 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 12:49:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:49:42.835029 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-c3d44062-e5ae-4ae2-b411-8a36d7d74de8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:49:42.907815 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-c3d44062-e5ae-4ae2-b411-8a36d7d74de8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.458193 Sep 09 12:49:42.908370 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Fri Sep 9 12:49:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:49:44.156425 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-ea5dc046-092e-47ea-9a6f-f42770d8c0e7 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:44.157455 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-ea5dc046-092e-47ea-9a6f-f42770d8c0e7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 09 12:49:44.157848 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 12:49:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:49:44.679040 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-def2cd7b-2186-4f36-9a0e-2a2e3399ae55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:49:44.757844 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-def2cd7b-2186-4f36-9a0e-2a2e3399ae55 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.461288 Sep 09 12:49:44.758380 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Fri Sep 9 12:49:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:49:45.979226 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-ea5dc046-092e-47ea-9a6f-f42770d8c0e7 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:45.980238 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-ea5dc046-092e-47ea-9a6f-f42770d8c0e7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 09 12:49:45.980629 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 12:49:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:49:46.509010 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-93c2b8bd-f02f-450e-94dd-86d4738dc5bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:49:46.579572 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-93c2b8bd-f02f-450e-94dd-86d4738dc5bf admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.462256 Sep 09 12:49:46.580123 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Fri Sep 9 12:49:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:49:47.819566 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-ea5dc046-092e-47ea-9a6f-f42770d8c0e7 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:47.820612 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-ea5dc046-092e-47ea-9a6f-f42770d8c0e7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Sep 09 12:49:47.821006 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 12:49:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:49:48.352995 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-60d5570c-dbd0-4286-95a9-ad98a7a32e3f admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:49:48.373049 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-60d5570c-dbd0-4286-95a9-ad98a7a32e3f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.414293 Sep 09 12:49:48.373589 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Fri Sep 9 12:49:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:50:46.249793 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-ea5dc046-092e-47ea-9a6f-f42770d8c0e7 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:50:46.251577 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-ea5dc046-092e-47ea-9a6f-f42770d8c0e7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001670 Sep 09 12:50:46.251977 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 12:50:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:50:46.262604 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:50:46.640523 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-4f1669c5-404e-4073-9979-b867db9993aa admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:50:46.661367 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-4f1669c5-404e-4073-9979-b867db9993aa admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403222 Sep 09 12:50:46.661839 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1292 bytes} [Fri Sep 9 12:50:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:50:46.684026 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG dbcounter [-] [112332] Writing DB stats nova_api:SELECT=14 {{(pid=112332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:50:46.687752 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-dbf49734-4658-4ad0-b730-3f117cab71e7 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:50:46.695819 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-dbf49734-4658-4ad0-b730-3f117cab71e7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013238 Sep 09 12:50:46.696347 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1283 bytes} [Fri Sep 9 12:50:46 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:50:46.708076 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-8637a5c1-9414-4218-bcc1-ab753f2636b3 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:50:46.715327 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-8637a5c1-9414-4218-bcc1-ab753f2636b3 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010774 Sep 09 12:50:46.715844 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1286 bytes} [Fri Sep 9 12:50:46 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:50:46.727428 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-45de1883-f4f9-493f-8023-c641463f6b56 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:50:46.735376 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-45de1883-f4f9-493f-8023-c641463f6b56 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011243 Sep 09 12:50:46.735893 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1286 bytes} [Fri Sep 9 12:50:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:50:46.746814 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-d2362285-b48d-4180-82d7-794d6061e7b1 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:50:46.754408 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-d2362285-b48d-4180-82d7-794d6061e7b1 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010981 Sep 09 12:50:46.754954 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1283 bytes} [Fri Sep 9 12:50:46 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:54:25.378063 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-45de1883-f4f9-493f-8023-c641463f6b56 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:54:25.379091 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-45de1883-f4f9-493f-8023-c641463f6b56 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Sep 09 12:54:25.379483 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 34/69] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 12:54:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:54:25.520572 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writing DB stats nova_api:SELECT=6 {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:54:25.662861 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-322826d9-84b7-436b-a6a9-6231d474d565 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:54:25.667644 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-322826d9-84b7-436b-a6a9-6231d474d565 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:54:25.676943 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-322826d9-84b7-436b-a6a9-6231d474d565 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:54:25.676943 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-322826d9-84b7-436b-a6a9-6231d474d565 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:54:25.676943 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-322826d9-84b7-436b-a6a9-6231d474d565 admin admin] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:54:25.676943 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-322826d9-84b7-436b-a6a9-6231d474d565 admin admin] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:54:25.677314 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-322826d9-84b7-436b-a6a9-6231d474d565 admin admin] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:54:25.703211 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-322826d9-84b7-436b-a6a9-6231d474d565 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.183762 Sep 09 12:54:25.705520 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 36/70] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Sep 9 12:54:25 2022] GET /compute/v2.1/os-services => generated 794 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:54:26.803561 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-45de1883-f4f9-493f-8023-c641463f6b56 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:54:26.804605 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-45de1883-f4f9-493f-8023-c641463f6b56 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Sep 09 12:54:26.804999 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 35/71] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 12:54:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:54:26.999834 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-e629f6f4-825b-4b64-bc16-a8e10fd9ef1b admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:54:27.003259 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-e629f6f4-825b-4b64-bc16-a8e10fd9ef1b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:54:27.003735 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-e629f6f4-825b-4b64-bc16-a8e10fd9ef1b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:54:27.004165 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-e629f6f4-825b-4b64-bc16-a8e10fd9ef1b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:54:27.004865 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-e629f6f4-825b-4b64-bc16-a8e10fd9ef1b admin admin] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:54:27.005309 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-e629f6f4-825b-4b64-bc16-a8e10fd9ef1b admin admin] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:54:27.005721 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-e629f6f4-825b-4b64-bc16-a8e10fd9ef1b admin admin] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:54:27.025000 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-e629f6f4-825b-4b64-bc16-a8e10fd9ef1b admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.077569 Sep 09 12:54:27.025516 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 37/72] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Sep 9 12:54:26 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:54:38.529039 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-45de1883-f4f9-493f-8023-c641463f6b56 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:54:38.530047 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-45de1883-f4f9-493f-8023-c641463f6b56 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Sep 09 12:54:38.530438 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 36/73] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 12:54:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:54:38.672042 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writing DB stats nova_cell0:SELECT=4 {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:54:38.672790 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writing DB stats nova_cell1:SELECT=4 {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:54:38.673935 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writing DB stats nova_api:SELECT=8 {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:54:38.721814 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-51f66fe2-57b8-41e2-abcd-ae9fc5cdec0f admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:54:38.725302 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-51f66fe2-57b8-41e2-abcd-ae9fc5cdec0f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:54:38.725772 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-51f66fe2-57b8-41e2-abcd-ae9fc5cdec0f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:54:38.726203 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-51f66fe2-57b8-41e2-abcd-ae9fc5cdec0f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:54:38.726948 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-51f66fe2-57b8-41e2-abcd-ae9fc5cdec0f admin admin] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:54:38.727397 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-51f66fe2-57b8-41e2-abcd-ae9fc5cdec0f admin admin] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:54:38.727818 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-51f66fe2-57b8-41e2-abcd-ae9fc5cdec0f admin admin] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:54:38.755580 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-51f66fe2-57b8-41e2-abcd-ae9fc5cdec0f admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.087886 Sep 09 12:54:38.756058 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 38/74] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Sep 9 12:54:38 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:54:39.837820 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG nova.api.openstack.wsgi [None req-45de1883-f4f9-493f-8023-c641463f6b56 admin admin] Calling method '>' {{(pid=112332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:54:39.838895 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: INFO nova.api.openstack.requestlog [None req-45de1883-f4f9-493f-8023-c641463f6b56 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 09 12:54:39.839297 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: [pid: 112332|app: 0|req: 37/75] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 12:54:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:54:40.041912 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-914f1284-2847-45df-94b3-bf3c2e9c2fc2 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:54:40.045352 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-914f1284-2847-45df-94b3-bf3c2e9c2fc2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:54:40.045801 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-914f1284-2847-45df-94b3-bf3c2e9c2fc2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:54:40.046257 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-914f1284-2847-45df-94b3-bf3c2e9c2fc2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:54:40.047015 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-914f1284-2847-45df-94b3-bf3c2e9c2fc2 admin admin] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:54:40.047469 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-914f1284-2847-45df-94b3-bf3c2e9c2fc2 admin admin] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:54:40.047883 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-914f1284-2847-45df-94b3-bf3c2e9c2fc2 admin admin] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:54:40.071123 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-914f1284-2847-45df-94b3-bf3c2e9c2fc2 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.080666 Sep 09 12:54:40.071662 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 39/76] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Sep 9 12:54:39 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:55:38.061875 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: Fri Sep 9 12:55:38 2022 - graceful shutdown triggered... Sep 09 12:55:38.061619 dv-cinder-813229-14-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 09 12:55:38.062835 dv-cinder-813229-14-iscsi devstack@n-api.service[112333]: Gracefully killing worker 2 (pid: 112333)... Sep 09 12:55:38.063429 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: Gracefully killing worker 1 (pid: 112332)... Sep 09 12:55:38.193175 dv-cinder-813229-14-iscsi devstack@n-api.service[112332]: DEBUG dbcounter [-] [112332] Writing DB stats nova_api:SELECT=4 {{(pid=112332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:55:39.062648 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: worker 1 buried after 1 seconds Sep 09 12:55:39.063217 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: worker 2 buried after 1 seconds Sep 09 12:55:39.063217 dv-cinder-813229-14-iscsi devstack@n-api.service[112331]: goodbye to uWSGI. Sep 09 12:55:39.064211 dv-cinder-813229-14-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 09 12:55:39.064750 dv-cinder-813229-14-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 09 12:55:39.067712 dv-cinder-813229-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 12:55:39.079608 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 12:55:39.081607 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 12:55:39 2022] *** Sep 09 12:55:39.081607 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 12:55:39.081607 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 12:55:39.081607 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: nodename: dv-cinder-813229-14-iscsi Sep 09 12:55:39.081607 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: machine: x86_64 Sep 09 12:55:39.081607 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: clock source: unix Sep 09 12:55:39.081607 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: pcre jit disabled Sep 09 12:55:39.081607 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: detected number of CPU cores: 4 Sep 09 12:55:39.081607 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: current working directory: / Sep 09 12:55:39.081607 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: detected binary path: /usr/bin/uwsgi-core Sep 09 12:55:39.082258 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: your processes number limit is 47680 Sep 09 12:55:39.082258 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: your memory page size is 4096 bytes Sep 09 12:55:39.082258 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: detected max file descriptor number: 2048 Sep 09 12:55:39.082258 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: lock engine: pthread robust mutexes Sep 09 12:55:39.082258 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: thunder lock: enabled Sep 09 12:55:39.082258 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 12:55:39.082258 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 12:55:39.123928 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: Python main interpreter initialized at 0x5650cb3c59c0 Sep 09 12:55:39.124050 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: python threads support enabled Sep 09 12:55:39.124050 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: your server socket listen backlog is limited to 100 connections Sep 09 12:55:39.124050 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: your mercy for graceful operations on workers is 90 seconds Sep 09 12:55:39.124281 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 12:55:39.124378 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: *** Operational MODE: preforking *** Sep 09 12:55:39.124644 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: *** uWSGI is running in multiple interpreter mode *** Sep 09 12:55:39.124644 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: spawned uWSGI master process (pid: 127758) Sep 09 12:55:39.124850 dv-cinder-813229-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 12:55:39.125455 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: spawned uWSGI worker 1 (pid: 127771, cores: 1) Sep 09 12:55:39.125986 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: spawned uWSGI worker 2 (pid: 127772, cores: 1) Sep 09 12:55:39.126294 dv-cinder-813229-14-iscsi devstack@n-api.service[127758]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 12:55:39.786460 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 12:55:39.806420 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 12:55:40.948614 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 12:55:40.948614 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: from cryptography.utils import int_from_bytes Sep 09 12:55:40.949294 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 12:55:40.949294 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: from cryptography.utils import int_from_bytes Sep 09 12:55:41.017532 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 12:55:41.017532 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: from cryptography.utils import int_from_bytes Sep 09 12:55:41.018120 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 12:55:41.018120 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: from cryptography.utils import int_from_bytes Sep 09 12:55:43.503006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 12:55:43.503664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 12:55:43.503887 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 12:55:43.505127 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 12:55:43.505372 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 12:55:43.505914 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.506300 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.506666 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.507065 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.507407 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.507728 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.508058 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.508394 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.508732 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.509004 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.509326 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.509809 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813229-14-iscsi {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.509921 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 12:55:43.510293 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.510377 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 12:55:43.510457 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.510720 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 12:55:43.510829 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.511090 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 12:55:43.511183 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.511349 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 12:55:43.511442 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.511725 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.511826 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.512040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.512138 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.512361 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.512547 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.512664 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.512989 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.513114 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.513301 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.513410 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.513619 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.513729 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.513937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.514044 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.514266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.514359 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.514556 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.514654 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.514878 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.514980 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.515223 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.515354 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813229-14-iscsi {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.515559 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.515679 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.515870 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.515991 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.516273 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.516392 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813229-14-iscsi {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.516602 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.516720 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.516916 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.517032 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.517238 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.517346 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.517543 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.517658 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.517967 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.518073 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.518287 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.518389 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.518648 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.518754 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.518976 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.519086 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.519299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.519406 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.519621 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.519710 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.520509 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.520684 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.520818 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.520910 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.521147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.521238 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.521459 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.521638 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.521768 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.521868 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.522079 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.522181 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813229-14-iscsi {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.522404 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.522521 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.522741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.522835 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.523055 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.523161 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.523480 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.523612 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.523812 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.524128 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.524455 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.524616 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.524781 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.524935 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.525092 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.525246 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.525401 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.525565 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.525716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.525860 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.526037 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.526204 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.526355 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.526663 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.526663 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.527009 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.527166 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.527323 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.527483 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.528748 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.528898 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.528992 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.529087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.529181 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.529278 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.529371 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.529457 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.529541 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.529633 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.529718 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.529815 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.529907 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.530399 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.530537 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.530635 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.530728 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.530810 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.530883 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.530961 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.531034 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.531112 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.531193 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.531266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.531338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.531409 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.531479 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.531564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.531637 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.531707 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.531881 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.531984 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.532209 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.532312 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.532528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.532621 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.532855 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.532956 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.533159 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.533266 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.533482 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.533587 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.533791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.533883 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.534105 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.534216 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.534411 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.534548 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.534761 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.534983 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.535161 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.535300 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.535416 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.535590 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.535770 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.535907 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.536112 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.536206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.536435 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.536535 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.536755 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.536856 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.537077 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.537171 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.537401 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.537503 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.537710 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.537802 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.538018 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.538111 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.538325 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.538469 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.538674 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.538779 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.539010 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.539102 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.539315 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.539406 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.539569 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.539672 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.539878 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.539971 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.540253 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.540526 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.540626 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.540728 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.540822 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.540908 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.541087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.541188 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.541394 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.541500 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.541698 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.541798 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.542007 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.542101 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.542314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.542420 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.542648 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.542741 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.542955 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.543049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.543265 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.543357 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.543573 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.543673 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.543878 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.543978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.544186 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.544280 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.544495 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.544600 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.544800 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.544903 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.545121 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.545213 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.545435 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.545545 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.545742 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.545834 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.546050 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.546152 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.546355 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.546457 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.546696 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.546790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.547005 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.547105 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.547313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.547405 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.547617 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.547718 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.547928 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.548022 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.548234 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.548327 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.548541 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.548667 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.548851 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.548955 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.549158 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.549257 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.549458 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.549614 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.549775 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.549875 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.550079 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.550172 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.550390 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.550540 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.550763 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.550864 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.551028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.551233 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.551367 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.551466 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.551667 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.551764 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.551970 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.552096 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.552276 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.552450 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.552583 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.552771 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.552887 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.553110 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.553217 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.553450 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.553544 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.553775 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.553866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.554093 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.554199 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.554405 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.554641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.554731 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.554816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.555033 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.555141 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.555353 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:55:43.555492 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.555693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.555793 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.556027 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.556149 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.556372 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.556492 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.556697 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.556826 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.557032 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.557179 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.557365 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.557492 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.557687 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.557808 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.558002 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.558467 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.558658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.558775 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.558894 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.559014 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.559133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.559259 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.559378 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.559491 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.559602 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.559757 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.559879 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.560116 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.560246 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.560471 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.560601 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.560817 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.560958 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.561079 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.561201 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.561396 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.561517 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.561713 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.561847 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.562030 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.562149 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.562357 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.562505 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.562726 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.562865 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.563043 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.563262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.563389 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.563656 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.563761 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.564024 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.564135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.564358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.564450 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.564679 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.564785 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.564995 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.565095 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.565311 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.565404 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.565630 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.565771 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.565986 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.566144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.566297 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.566461 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.566640 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.567562 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.567866 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.567951 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.568161 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.568333 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.568477 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.568588 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.568794 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.568895 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.569109 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.569274 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.569430 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.569620 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.569721 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.570036 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.570149 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.570358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.570471 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.570741 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.570919 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.571051 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.571320 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.571464 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.571644 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.571800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.571960 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.572171 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.572350 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.572509 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.572660 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.572870 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.573012 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.573177 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.573313 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.573486 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.573592 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.573800 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.573901 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.574109 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.574201 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.574436 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.574592 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.574798 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.574890 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.575114 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.575216 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.575452 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.575547 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.575766 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.575860 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.576084 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.576177 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.576396 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.576494 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.576965 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.577064 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.577283 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.577383 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.577596 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.577696 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.577908 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.577999 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.578218 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.578388 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.578557 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.578665 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.578874 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.578966 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.579184 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.579291 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.579501 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.579593 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.579809 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.579908 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.580120 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.580221 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.580439 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.580531 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.580759 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.580886 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.581076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.581198 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.581385 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.581477 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.581699 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.581800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.582023 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.582125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.582425 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.583117 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.583321 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.583477 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.583590 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.583762 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.583904 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.584099 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.584227 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.584413 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.584544 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.584745 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.584862 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.585076 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.585168 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.585400 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.585503 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.585711 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.585804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.586027 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.586121 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.586337 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.586430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.586678 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.586791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.586990 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.587083 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.587311 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.587412 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.587621 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.587723 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.587929 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.588022 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.588235 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.588328 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.588542 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.588643 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.588852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.588944 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.589179 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.589273 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.589492 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.589642 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.589800 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.589903 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.590111 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.590203 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.590420 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.590534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.590824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.591004 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.591155 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.591345 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.591462 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.591660 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.591790 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.591988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.592111 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.592314 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.592444 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.592636 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.592757 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.592971 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.593093 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.593296 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.593417 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.593612 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.593791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.593930 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.594050 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.594249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.594377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.594591 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.594726 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.594908 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.595027 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.595370 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.595692 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.596023 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.596291 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.596431 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.596646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.596774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.596954 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.597079 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.597279 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.597399 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.597625 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.597721 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.598014 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.598230 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.598394 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.598597 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.598776 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.598935 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.599100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.599265 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.599419 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.599595 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.599732 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.599922 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.600023 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.600246 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.600347 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.600578 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.600670 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.600902 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.601002 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.601233 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.601349 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.601552 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.601657 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.601864 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.601966 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.602185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.602277 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.602544 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.602642 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.602842 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.602936 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.603147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.603248 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.603463 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.603564 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.603794 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.603898 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.604125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.604215 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.604438 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.604537 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.604756 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.604863 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.605074 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.605166 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.605387 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.605466 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.605704 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.605798 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.606017 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.606109 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.606327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.606418 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.606673 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.606781 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.606997 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.607126 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.607316 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.607419 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.607633 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.607746 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.607942 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.608035 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.608250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.608353 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.608568 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.608662 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.608879 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.608972 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.609186 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.609279 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.609497 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.609602 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.609813 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.609917 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.610130 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.610230 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.610442 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.610572 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.610793 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.610899 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.611119 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.611227 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.611430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.611523 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.611737 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.611831 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.612065 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.612173 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.612375 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.612467 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.612679 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.612778 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.612989 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.613094 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.613294 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.613393 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.613706 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.613817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.614015 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.614281 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.614417 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.614735 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.614831 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.615060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.615285 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.615429 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.615779 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.615897 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.616079 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.616241 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.616455 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.616574 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.616786 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.616886 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.617114 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.617213 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.617421 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.617920 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.618263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.618359 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.618612 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.618730 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.618952 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.619055 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.619274 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.619377 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.619594 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.619705 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.619967 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.620074 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.620226 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.620326 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.620544 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.620655 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.620864 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.620966 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.621191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.621460 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.621570 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.621803 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.621912 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.622120 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.622214 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.622445 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.622578 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.622842 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.623160 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.623297 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.623497 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.623626 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.623825 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.623955 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.624146 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.624265 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.624465 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.624587 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.624788 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.624932 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.625104 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.625225 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.625419 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.625546 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.625738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.625870 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.626053 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.626175 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.626369 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.626565 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.626701 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.626826 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.627011 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.627130 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.627319 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.627438 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.627633 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.627768 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.627944 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.628064 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.628258 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.628387 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.628575 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.628695 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.628882 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.629010 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.629712 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.629840 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.630044 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.630170 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.630362 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.630534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.630709 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.630832 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.631002 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.631145 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.631318 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.631454 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.631624 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.631756 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.631953 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.632099 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.632269 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.632402 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.632578 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.632728 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.632890 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.633032 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.633201 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.633322 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.633553 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.633753 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.633869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.633980 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.634192 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.634321 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.634606 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.634794 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.634957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.635110 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.635261 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.635433 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.635598 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.635750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.635908 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.636067 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.636223 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.636374 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.636535 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.636694 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.636851 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.637010 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.637161 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.637310 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.637490 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.637644 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.637794 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.637944 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.638093 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.638244 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.638409 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.638598 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.638761 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.638912 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.639062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.639222 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.639395 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.639548 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.639706 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.639859 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.640009 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.640172 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.640324 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.640474 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.640625 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.640775 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.640933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.641093 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.641245 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.641405 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.641556 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.641706 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.641863 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.642029 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.642180 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.642338 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.642521 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.643246 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.643422 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.643576 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.643737 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.643898 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.644062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.644215 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.644215 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.644522 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.644674 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.644867 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.645638 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.645908 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.646158 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.646335 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.646528 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.646700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.646700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.647002 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.647169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.647329 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.647481 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.647640 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.647792 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.647955 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.648106 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.648256 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.648412 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.648565 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.648715 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.648875 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.649043 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.649202 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.649363 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.649522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.649673 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.649834 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.649994 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.650155 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.650314 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.650466 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.650714 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.650882 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.651045 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.651204 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.651355 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.651507 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.651666 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.651817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.651968 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.652119 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.652269 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.652427 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.652593 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.652752 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.652903 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.653064 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.653224 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.653382 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.653382 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.653687 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.653847 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.654006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.654165 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.654317 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.654497 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.654658 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.654810 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.654960 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.655120 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.655286 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.655446 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.655598 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.655756 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.655914 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.656072 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.656241 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.656395 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.656544 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.656695 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.656845 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.656995 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.657220 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.657389 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.657542 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.657693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.657854 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.658005 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.658165 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.658317 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.658476 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.658684 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.658844 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.659003 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.659168 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.659330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.659483 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.659641 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.659800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.659961 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.660120 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.660280 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.660439 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.660661 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.660921 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.661125 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.661288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.661460 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.661615 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.661775 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.661927 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.662088 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.662247 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.662399 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.662692 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.662889 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.663065 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.663231 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.663390 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.663390 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.663691 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.663842 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.664008 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.664160 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.664312 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.664463 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.664622 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.664789 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.665024 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.665177 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.665327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.665485 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.665637 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.665807 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.665973 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.666144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.666298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.666448 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.666636 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.666799 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.666961 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.667114 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.667277 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.667428 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.667585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.667585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.667909 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.668068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.668221 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.668371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.668528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.668698 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.668850 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.669001 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.669150 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.669150 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.669435 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.669599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.669770 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.669770 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.670064 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.670230 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.670388 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.670645 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.670814 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.670967 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.671118 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.671269 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.671434 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.671587 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.671744 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.671913 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.672066 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.672254 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.672420 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.672581 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.672741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.672892 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.673051 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.673204 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.673364 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.673515 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.673667 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.673824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.673993 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.674146 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.674316 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.674475 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.674653 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.674805 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.674956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.675123 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.675283 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.675442 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.675593 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.675750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.675912 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.676642 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.677301 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.677478 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.677640 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.677793 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.677952 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.678120 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.678273 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.678434 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.678623 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.678789 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.678789 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.679100 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.679252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.679403 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.679553 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.679713 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.679713 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.680011 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.680169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.680321 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.680472 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.680632 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.680784 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.680934 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.681103 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.681262 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.681420 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.681583 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.681735 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.681895 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.682054 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.682207 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.682367 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.682559 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.682719 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.682870 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.683021 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.683194 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.683398 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.683559 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.683718 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.683878 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.684038 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.684191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.684356 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.684516 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.684671 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.684822 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.684980 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.685152 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.685305 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.685457 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.685607 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.685766 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.685927 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.686092 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.686252 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.686404 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.686583 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.686739 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.686890 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.687053 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.687217 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.687377 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.687529 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.687688 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.687841 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.688163 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.688339 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.688492 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.688645 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.688805 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.688972 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.689125 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.689284 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.689456 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.689608 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.689766 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.689929 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.690082 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.690233 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.690391 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.690561 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.690734 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.690899 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.691051 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.691210 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.691363 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.691533 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.691730 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.692478 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.692637 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.692797 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.693118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.693274 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.693442 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.693602 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.693801 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.693961 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.694115 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.694115 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.694431 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.694610 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.694780 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.694933 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.695084 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.695243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.695405 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.695557 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.695708 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.695708 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.696010 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.696164 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.696340 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.696493 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.696653 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.696818 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.696971 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.697137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.697299 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.697460 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.697613 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.697764 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.697923 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.698085 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.698246 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.698418 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.698609 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.698772 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.698926 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.699096 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.699249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.699401 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.699559 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.699711 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.699864 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.700029 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.700182 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.700353 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.700506 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.700658 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.700825 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.700979 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.701131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.701290 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.701450 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.701865 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.702031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.702184 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.702350 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.702534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.702728 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.702890 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.703053 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.703213 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.703366 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.703527 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.703680 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.703832 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.704000 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.704153 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.704313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.704465 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.704625 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.704805 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.704959 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.705110 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.705261 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.705419 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.705573 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.705734 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.705886 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.706045 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.706206 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.706366 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.706593 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.706776 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.706949 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.707109 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.707262 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.707469 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.707681 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.707960 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.708221 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.708221 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.708576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.708738 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.708902 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.709063 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.709234 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.709388 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.709540 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.709700 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.709863 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.709863 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.710160 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.710321 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.710502 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.710714 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.710898 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.711053 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.711213 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.711213 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.711514 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.711665 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.711830 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.711997 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.712151 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.712302 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.712453 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.712620 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.712781 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.712941 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.713101 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.713274 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.713440 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.713603 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.713769 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.713931 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.714085 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.714245 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.714408 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.714598 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.714753 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.714909 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.714909 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.715210 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.715373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.715526 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.715526 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.715824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.715992 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.716155 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.716315 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.716468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.716627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.716790 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.716953 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.717116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.717116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.717421 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.717580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.717733 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.717885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.718051 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.718214 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.718366 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.718611 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.718787 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.719043 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.719219 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.719389 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.719542 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.719693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.719852 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.720015 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.720167 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.720328 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.720481 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.720641 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.720802 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.720968 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.721144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.721306 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.721467 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.721620 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.721620 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.721924 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.721924 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.722213 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.722365 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.722535 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.722706 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.722868 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.723065 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.723315 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.723586 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.723822 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.723995 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.724150 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.724303 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.724472 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.724633 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.724794 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.724956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.725116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.725276 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.725430 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.725603 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.725767 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.725919 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.726078 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.726230 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.726393 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.726571 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.726749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.726920 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.727072 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.727224 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.727376 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.727376 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.727701 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.727863 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.728015 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.728015 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.728311 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.728471 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.728633 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.728786 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.728937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.729096 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.729249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.729410 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.729582 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.729754 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.729907 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.730059 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.730211 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.730372 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.730735 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.730903 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.731056 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.731208 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.731371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.731538 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.731697 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.731867 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.732021 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.732187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.732341 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.732506 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.732659 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.732819 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.732972 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.733140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.733307 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.733462 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.733621 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.733796 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.733959 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.734111 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.734277 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.734438 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.734628 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.734782 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.734936 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.735087 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.735252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.735405 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.735557 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.735708 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.735878 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.736039 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.736201 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.736353 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.736505 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.736667 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.736827 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.736994 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.737147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.737147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.737441 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.737600 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.737752 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.737923 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.738089 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.738242 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.738404 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.739175 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.739434 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.739674 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.739836 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.739990 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.740150 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.740304 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.740469 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.740636 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.740800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.740966 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.741119 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.741281 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.741444 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.741598 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.741757 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.741918 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.742071 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.742223 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.742384 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.742567 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.742736 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.742914 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.743066 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.743226 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.743226 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.743531 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.743531 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.743845 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.743997 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.744155 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.744321 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.744484 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.744637 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.744799 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.744952 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.745117 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.745276 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.745430 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.745589 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.745749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.745901 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.746070 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.746223 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.746374 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.746596 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.746766 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.746930 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.747101 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.747262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.747415 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.747576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.747736 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.747898 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.748059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.748059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.748354 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.748506 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.748659 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.748835 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.748996 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.749149 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.749309 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.749469 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.749623 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.749853 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.750015 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.750181 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.750340 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.750518 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.750692 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.750847 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.751009 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.751171 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.751331 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.751484 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.751645 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.751807 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.751960 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.752121 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.752274 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.752425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.752590 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.752744 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.752906 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.753059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.753211 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.753363 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.753524 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.753684 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.753838 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.753990 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.754147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.754890 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.755068 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.755226 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.755392 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.755544 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.755696 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.755862 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.756015 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.756174 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.756335 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.756488 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.756639 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.756800 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.756961 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.757135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.757289 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.757450 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.757612 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.757773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.757938 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.758099 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.758253 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.758405 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.758640 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.758797 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.758958 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.759118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.759277 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.759440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.759603 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.759756 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.759907 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.760066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.760227 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.760389 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.760542 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.760701 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.760854 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.761005 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.761178 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.761346 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.761517 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.761670 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.761820 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.761971 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.762131 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.762293 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.762445 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.762633 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.762788 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.763029 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.763215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.763374 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.763537 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.763698 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.763850 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.764009 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.764170 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.764324 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.764324 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.764612 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.764775 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.764928 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.765093 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.765252 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.765412 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.765575 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.765727 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.765886 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.766052 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.766211 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.766372 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.766543 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.766713 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.766876 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.767043 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.767199 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.767352 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.767503 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.767666 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.767832 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.767986 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.768145 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.768297 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.768455 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.768607 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.768772 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.768924 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.769075 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.769234 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.769386 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.769538 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.769709 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.769894 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.770052 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.770212 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.770370 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.770593 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.770761 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.770923 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.771083 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.771243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.771394 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.771558 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.771659 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.771734 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.771873 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.771978 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.772066 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.772162 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.772249 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.772379 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.772473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.772607 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.772728 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.772849 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.772973 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.773086 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.773199 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.773320 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.773447 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.773562 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.773682 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.773805 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.773918 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.774031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.774152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.774273 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.774386 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.774515 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.774646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.774791 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.774937 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.775077 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.775209 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.775340 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.775470 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.775615 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.775747 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.775879 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.776009 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.776009 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.776255 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.776255 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.776255 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.776255 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.776255 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.776255 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.776995 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.777141 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.777273 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.777404 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.777534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.777673 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.777890 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.778026 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.778164 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.778309 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.778441 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.778591 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.778591 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.778853 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.778999 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.778999 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.779255 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.779385 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.779524 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.779663 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.779663 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.779919 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.780057 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.780057 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.780326 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.780458 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.780458 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.780712 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.780841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 12:55:43.780981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.780981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.780981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.780981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.780981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.781596 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.781767 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.782157 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.782577 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:55:43.782897 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 12:55:43.841051 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO dbcounter [None req-0bda2812-5bf6-4496-9053-d0589303d271 None None] Registered counter for database nova_api Sep 09 12:55:43.846433 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO dbcounter [None req-c47ca6d6-895f-4cd4-8917-b42b3f6d6c4c None None] Registered counter for database nova_api Sep 09 12:55:43.862404 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_db.sqlalchemy.engines [None req-0bda2812-5bf6-4496-9053-d0589303d271 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:55:43.867909 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_db.sqlalchemy.engines [None req-c47ca6d6-895f-4cd4-8917-b42b3f6d6c4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:55:43.869405 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writer thread running {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:55:43.874737 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writer thread running {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:55:43.927340 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.context [None req-0bda2812-5bf6-4496-9053-d0589303d271 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5b125c4-b69c-4216-8126-4e61782bc3cb(cell1) {{(pid=127771) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 12:55:43.931216 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0bda2812-5bf6-4496-9053-d0589303d271 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:55:43.931698 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0bda2812-5bf6-4496-9053-d0589303d271 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:55:43.932261 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.context [None req-c47ca6d6-895f-4cd4-8917-b42b3f6d6c4c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5b125c4-b69c-4216-8126-4e61782bc3cb(cell1) {{(pid=127772) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 12:55:43.933263 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0bda2812-5bf6-4496-9053-d0589303d271 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:55:43.934011 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0bda2812-5bf6-4496-9053-d0589303d271 None None] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:55:43.934462 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0bda2812-5bf6-4496-9053-d0589303d271 None None] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:55:43.936404 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c47ca6d6-895f-4cd4-8917-b42b3f6d6c4c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:55:43.936542 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0bda2812-5bf6-4496-9053-d0589303d271 None None] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:55:43.936892 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c47ca6d6-895f-4cd4-8917-b42b3f6d6c4c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:55:43.938501 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c47ca6d6-895f-4cd4-8917-b42b3f6d6c4c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:55:43.938615 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO dbcounter [None req-0bda2812-5bf6-4496-9053-d0589303d271 None None] Registered counter for database nova_cell0 Sep 09 12:55:43.939265 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c47ca6d6-895f-4cd4-8917-b42b3f6d6c4c None None] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:55:43.939726 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c47ca6d6-895f-4cd4-8917-b42b3f6d6c4c None None] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:55:43.941785 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c47ca6d6-895f-4cd4-8917-b42b3f6d6c4c None None] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:55:43.942735 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO dbcounter [None req-0bda2812-5bf6-4496-9053-d0589303d271 None None] Registered counter for database nova_cell1 Sep 09 12:55:43.944122 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO dbcounter [None req-c47ca6d6-895f-4cd4-8917-b42b3f6d6c4c None None] Registered counter for database nova_cell0 Sep 09 12:55:43.948243 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO dbcounter [None req-c47ca6d6-895f-4cd4-8917-b42b3f6d6c4c None None] Registered counter for database nova_cell1 Sep 09 12:55:43.949929 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_db.sqlalchemy.engines [None req-0bda2812-5bf6-4496-9053-d0589303d271 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:55:43.952005 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_db.sqlalchemy.engines [None req-0bda2812-5bf6-4496-9053-d0589303d271 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:55:43.956002 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_db.sqlalchemy.engines [None req-c47ca6d6-895f-4cd4-8917-b42b3f6d6c4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:55:43.956166 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writer thread running {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:55:43.958564 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_db.sqlalchemy.engines [None req-c47ca6d6-895f-4cd4-8917-b42b3f6d6c4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:55:43.965292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writer thread running {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:55:43.966607 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writer thread running {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:55:44.100087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writer thread running {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:55:44.109225 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO dbcounter [None req-0bda2812-5bf6-4496-9053-d0589303d271 None None] Registered counter for database nova_cell0 Sep 09 12:55:44.115676 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO dbcounter [None req-c47ca6d6-895f-4cd4-8917-b42b3f6d6c4c None None] Registered counter for database nova_cell0 Sep 09 12:55:44.116029 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_db.sqlalchemy.engines [None req-0bda2812-5bf6-4496-9053-d0589303d271 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:55:44.120626 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writer thread running {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:55:44.128175 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_db.sqlalchemy.engines [None req-c47ca6d6-895f-4cd4-8917-b42b3f6d6c4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:55:44.133589 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writer thread running {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:55:44.444717 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: WARNING keystonemiddleware.auth_token [None req-0bda2812-5bf6-4496-9053-d0589303d271 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 12:55:44.452009 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: WARNING keystonemiddleware.auth_token [None req-c47ca6d6-895f-4cd4-8917-b42b3f6d6c4c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 12:55:44.452262 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: WARNING keystonemiddleware.auth_token [None req-0bda2812-5bf6-4496-9053-d0589303d271 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 12:55:44.459761 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: WARNING keystonemiddleware.auth_token [None req-c47ca6d6-895f-4cd4-8917-b42b3f6d6c4c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 12:55:44.802334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: WARNING keystonemiddleware.auth_token [None req-0bda2812-5bf6-4496-9053-d0589303d271 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 12:55:44.806948 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: WARNING keystonemiddleware.auth_token [None req-c47ca6d6-895f-4cd4-8917-b42b3f6d6c4c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 12:55:44.808513 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: WARNING keystonemiddleware.auth_token [None req-0bda2812-5bf6-4496-9053-d0589303d271 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 12:55:44.812998 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: WARNING keystonemiddleware.auth_token [None req-c47ca6d6-895f-4cd4-8917-b42b3f6d6c4c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 12:55:44.813909 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5650cb3c59c0 pid: 127771 (default app) Sep 09 12:55:44.819137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5650cb3c59c0 pid: 127772 (default app) Sep 09 12:56:22.056816 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=3 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:56:22.058522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=3 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:56:22.059463 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=3 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:56:22.061181 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=3 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:56:23.813201 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-f6ff03d5-5fe2-4777-8742-5a239294c364 tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] Action: 'create', calling method: .version_select at 0x7f3184087430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1072441188", "metadata": {"Type": "work"}}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:56:23.815881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-f6ff03d5-5fe2-4777-8742-5a239294c364 tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] Request method failure captured: Sep 09 12:56:23.815881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 12:56:23.815881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 12:56:23.815881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 12:56:23.815881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 12:56:23.815881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 122 Sep 09 12:56:23.815881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 12:56:23.815881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 12:56:23.815881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 12:56:23.815881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 12:56:23.815881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzf1wrD4UnAtBot4dyORXoElBupkJCM8oYeH9tBZ8xraY3KafwQ1I1krGauRDtzxyaaQpcHOkLglpKfUekZRALhYekyasCpqYQ3FRI2MX9B2PqFo60M8Bsat5f_ggajkaWlz-XZkGZ_FgfZV77g7QMRnOczw4kUcR-AzbKFYa1AWRM8 Sep 09 12:56:23.815881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 12:56:23.815881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 12:56:23.815881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 12:56:23.815881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 12:56:23.815881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 12:56:23.815881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 12:56:23.815881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: 3a03f8b7f17247c18fa91a7d64a98eb3 Sep 09 12:56:23.815881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-VolumesNegativeTest-758848789 Sep 09 12:56:23.815881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 12:56:23.815881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 12:56:23.817831 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3a03f8b7f17247c18fa91a7d64a98eb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3a03f8b7f17247c18fa91a7d64a98eb3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3a03f8b7f17247c18fa91a7d64a98eb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3a03f8b7f17247c18fa91a7d64a98eb3"}]}] Sep 09 12:56:23.817831 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-VolumesNegativeTest-758848789 Sep 09 12:56:23.817831 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: 3a03f8b7f17247c18fa91a7d64a98eb3 Sep 09 12:56:23.817831 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-VolumesNegativeTest-758848789 Sep 09 12:56:23.817831 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-VolumesNegativeTest-758848789-project Sep 09 12:56:23.817831 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 12:56:23.817831 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 12:56:23.817831 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 0c8d72e1a3054b4db0a79e72a361c0be Sep 09 12:56:23.817831 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-VolumesNegativeTest-758848789-project Sep 09 12:56:23.817831 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Sep 09 12:56:23.817831 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1072441188", "metadata": {"Type": "work"}}} Sep 09 12:56:23.817831 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: Sep 09 12:56:23.817831 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 12:56:23.819154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1072441188', 'metadata': {'Type': 'work'}}}} Sep 09 12:56:23.819154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:56:23.819154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:56:23.819154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 12:56:23.819154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 12:56:23.819154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 12:56:23.819154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise error Sep 09 12:56:23.819154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 09 12:56:23.819154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:56:23.819154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 12:56:23.819154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 12:56:23.819154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:56:23.819154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 12:56:23.819154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi '#$%' Sep 09 12:56:23.819154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:56:23.819154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:56:23.819154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:56:23.819154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:56:23.819154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:56:23.819154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:56:23.819154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:56:23.819154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:56:23.820481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:56:23.820481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:56:23.820481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:56:23.820481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:56:23.820481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 12:56:23.820481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 12:56:23.820481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 12:56:23.820481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 12:56:23.820481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 12:56:23.820481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 12:56:23.820481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 12:56:23.820481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:56:23.820481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:56:23.820481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:56:23.820481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:56:23.820481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:56:23.820481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:56:23.820481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 12:56:23.820481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 12:56:23.823157 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 12:56:23.823157 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:56:23.823157 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-f6ff03d5-5fe2-4777-8742-5a239294c364 tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:56:23.823157 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-f6ff03d5-5fe2-4777-8742-5a239294c364 tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.782040 Sep 09 12:56:23.823157 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1156 bytes} [Fri Sep 9 12:56:22 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1784 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 12:56:23.844635 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=3 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:56:23.845573 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=3 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:56:23.846310 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=3 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:56:23.847702 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=3 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:56:23.975753 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-60f406f9-8605-421b-a680-ae9c18b12636 tempest-VolumesTestJSON-1643515077 tempest-VolumesTestJSON-1643515077-project] Calling method '.version_select at 0x7f3184087d30>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:24.123207 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-abbb1976-86d7-4786-9a24-f12598b7cfbc tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] Action: 'create', calling method: .version_select at 0x7f31840dd040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1986636828", "metadata": {"Type": "work"}}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:56:24.130413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-abbb1976-86d7-4786-9a24-f12598b7cfbc tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] Request method failure captured: Sep 09 12:56:24.130413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 12:56:24.130413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 12:56:24.130413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 12:56:24.130413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 12:56:24.130413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 120 Sep 09 12:56:24.130413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 12:56:24.130413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 12:56:24.130413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 12:56:24.130413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 12:56:24.130413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGzf1wrD4UnAtBot4dyORXoElBupkJCM8oYeH9tBZ8xraY3KafwQ1I1krGauRDtzxyaaQpcHOkLglpKfUekZRALhYekyasCpqYQ3FRI2MX9B2PqFo60M8Bsat5f_ggajkaWlz-XZkGZ_FgfZV77g7QMRnOczw4kUcR-AzbKFYa1AWRM8 Sep 09 12:56:24.130413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 12:56:24.130413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 12:56:24.130413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 12:56:24.130413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 12:56:24.130413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 12:56:24.130413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 12:56:24.130413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: 3a03f8b7f17247c18fa91a7d64a98eb3 Sep 09 12:56:24.130413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-VolumesNegativeTest-758848789 Sep 09 12:56:24.130413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 12:56:24.130413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 12:56:24.131862 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3a03f8b7f17247c18fa91a7d64a98eb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3a03f8b7f17247c18fa91a7d64a98eb3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3a03f8b7f17247c18fa91a7d64a98eb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3a03f8b7f17247c18fa91a7d64a98eb3"}]}] Sep 09 12:56:24.131862 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-VolumesNegativeTest-758848789 Sep 09 12:56:24.131862 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: 3a03f8b7f17247c18fa91a7d64a98eb3 Sep 09 12:56:24.131862 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-VolumesNegativeTest-758848789 Sep 09 12:56:24.131862 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-VolumesNegativeTest-758848789-project Sep 09 12:56:24.131862 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 12:56:24.131862 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 12:56:24.131862 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: 0c8d72e1a3054b4db0a79e72a361c0be Sep 09 12:56:24.131862 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-VolumesNegativeTest-758848789-project Sep 09 12:56:24.131862 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Sep 09 12:56:24.131862 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1986636828", "metadata": {"Type": "work"}}} Sep 09 12:56:24.131862 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: Sep 09 12:56:24.131862 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 12:56:24.132627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1986636828', 'metadata': {'Type': 'work'}}}} Sep 09 12:56:24.132627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:56:24.132627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:56:24.132627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 12:56:24.132627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 12:56:24.132627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 12:56:24.132627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise error Sep 09 12:56:24.132627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 09 12:56:24.132627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:24.132627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 09 12:56:24.132627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 12:56:24.132627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:24.132627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 12:56:24.132627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi '0' Sep 09 12:56:24.132627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:24.132627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:56:24.132627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:24.132627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:56:24.132627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:56:24.132627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:56:24.132627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:56:24.132627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:56:24.133882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:56:24.133882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:56:24.133882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:56:24.133882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:56:24.133882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 12:56:24.133882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 12:56:24.133882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 12:56:24.133882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 12:56:24.133882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 12:56:24.133882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 12:56:24.133882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 12:56:24.133882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:24.133882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:56:24.133882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:24.133882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:56:24.133882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:56:24.133882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:56:24.133882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 12:56:24.133882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 12:56:24.135132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 12:56:24.135132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:24.137339 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-abbb1976-86d7-4786-9a24-f12598b7cfbc tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:56:24.138592 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-abbb1976-86d7-4786-9a24-f12598b7cfbc tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.312755 Sep 09 12:56:24.139690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 1/2] 10.222.0.46 () {60 vars in 1156 bytes} [Fri Sep 9 12:56:23 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 316 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 12:56:24.180386 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-80ca87f2-6b55-4999-a2da-2bb4a8cab59a tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] Action: 'create', calling method: .version_select at 0x7f31840ddb80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1218088808", "metadata": {"Type": "work"}}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:56:24.181774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-80ca87f2-6b55-4999-a2da-2bb4a8cab59a tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] Request method failure captured: Sep 09 12:56:24.181774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 12:56:24.181774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 12:56:24.181774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 12:56:24.181774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 12:56:24.181774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 119 Sep 09 12:56:24.181774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 12:56:24.181774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 12:56:24.181774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 12:56:24.181774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 12:56:24.181774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGzf1wrD4UnAtBot4dyORXoElBupkJCM8oYeH9tBZ8xraY3KafwQ1I1krGauRDtzxyaaQpcHOkLglpKfUekZRALhYekyasCpqYQ3FRI2MX9B2PqFo60M8Bsat5f_ggajkaWlz-XZkGZ_FgfZV77g7QMRnOczw4kUcR-AzbKFYa1AWRM8 Sep 09 12:56:24.181774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 12:56:24.181774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 12:56:24.181774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 12:56:24.181774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 12:56:24.181774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 12:56:24.181774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 12:56:24.181774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: 3a03f8b7f17247c18fa91a7d64a98eb3 Sep 09 12:56:24.181774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-VolumesNegativeTest-758848789 Sep 09 12:56:24.181774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 12:56:24.181774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 12:56:24.183217 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3a03f8b7f17247c18fa91a7d64a98eb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3a03f8b7f17247c18fa91a7d64a98eb3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3a03f8b7f17247c18fa91a7d64a98eb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3a03f8b7f17247c18fa91a7d64a98eb3"}]}] Sep 09 12:56:24.183217 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-VolumesNegativeTest-758848789 Sep 09 12:56:24.183217 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: 3a03f8b7f17247c18fa91a7d64a98eb3 Sep 09 12:56:24.183217 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-VolumesNegativeTest-758848789 Sep 09 12:56:24.183217 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-VolumesNegativeTest-758848789-project Sep 09 12:56:24.183217 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 12:56:24.183217 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 12:56:24.183217 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: 0c8d72e1a3054b4db0a79e72a361c0be Sep 09 12:56:24.183217 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-VolumesNegativeTest-758848789-project Sep 09 12:56:24.183217 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Sep 09 12:56:24.183217 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1218088808", "metadata": {"Type": "work"}}} Sep 09 12:56:24.183217 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: Sep 09 12:56:24.183217 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 12:56:24.184299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1218088808', 'metadata': {'Type': 'work'}}}} Sep 09 12:56:24.184299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:56:24.184299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:56:24.184299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 12:56:24.184299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 12:56:24.184299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 12:56:24.184299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise error Sep 09 12:56:24.184299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 09 12:56:24.184299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:24.184299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 12:56:24.184299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 12:56:24.184299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:24.184299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 12:56:24.184299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi '' Sep 09 12:56:24.184299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:24.184299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:56:24.184299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:24.184299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:56:24.184299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:56:24.184299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:56:24.184299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:56:24.184299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:56:24.185655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:56:24.185655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:56:24.185655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:56:24.185655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:56:24.185655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 12:56:24.185655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 12:56:24.185655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 12:56:24.185655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 12:56:24.185655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 12:56:24.185655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 12:56:24.185655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 12:56:24.185655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:24.185655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:56:24.185655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:24.185655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:56:24.185655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:56:24.185655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:56:24.185655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 12:56:24.185655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 12:56:24.186956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 12:56:24.186956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:24.189226 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-80ca87f2-6b55-4999-a2da-2bb4a8cab59a tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:56:24.190309 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-80ca87f2-6b55-4999-a2da-2bb4a8cab59a tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.043622 Sep 09 12:56:24.191525 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 2/3] 10.222.0.46 () {60 vars in 1156 bytes} [Fri Sep 9 12:56:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 12:56:24.209237 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c56c8023-d582-412e-ba43-01d735d82c53 tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] Calling method '.version_select at 0x7f3183fe3e50>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:24.818063 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-60f406f9-8605-421b-a680-ae9c18b12636 tempest-VolumesTestJSON-1643515077 tempest-VolumesTestJSON-1643515077-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/9cb705ca-0a29-4792-8921-ca3a778cb88c" status: 200 len: 350 microversion: 2.1 time: 0.849870 Sep 09 12:56:24.818672 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 12:56:23 2022] GET /compute/v2.1/os-volumes/9cb705ca-0a29-4792-8921-ca3a778cb88c => generated 350 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:56:25.881098 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-c56c8023-d582-412e-ba43-01d735d82c53 tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] HTTP exception thrown: Volume tempest-invalid-1904282386 could not be found. Sep 09 12:56:25.885512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c56c8023-d582-412e-ba43-01d735d82c53 tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] Request method failure captured: Sep 09 12:56:25.885512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1904282386 HTTP/1.1 Sep 09 12:56:25.885512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 12:56:25.885512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 12:56:25.885512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 12:56:25.885512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 12:56:25.885512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 12:56:25.885512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 12:56:25.885512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 12:56:25.885512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 12:56:25.885512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGzf1wrD4UnAtBot4dyORXoElBupkJCM8oYeH9tBZ8xraY3KafwQ1I1krGauRDtzxyaaQpcHOkLglpKfUekZRALhYekyasCpqYQ3FRI2MX9B2PqFo60M8Bsat5f_ggajkaWlz-XZkGZ_FgfZV77g7QMRnOczw4kUcR-AzbKFYa1AWRM8 Sep 09 12:56:25.885512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 12:56:25.885512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 12:56:25.885512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 12:56:25.885512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 12:56:25.885512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 12:56:25.885512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 12:56:25.885512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: 3a03f8b7f17247c18fa91a7d64a98eb3 Sep 09 12:56:25.885512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-VolumesNegativeTest-758848789 Sep 09 12:56:25.885512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 12:56:25.885512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 12:56:25.886528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3a03f8b7f17247c18fa91a7d64a98eb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3a03f8b7f17247c18fa91a7d64a98eb3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3a03f8b7f17247c18fa91a7d64a98eb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3a03f8b7f17247c18fa91a7d64a98eb3"}]}] Sep 09 12:56:25.886528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-VolumesNegativeTest-758848789 Sep 09 12:56:25.886528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: 3a03f8b7f17247c18fa91a7d64a98eb3 Sep 09 12:56:25.886528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-VolumesNegativeTest-758848789 Sep 09 12:56:25.886528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-VolumesNegativeTest-758848789-project Sep 09 12:56:25.886528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 12:56:25.886528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 12:56:25.886528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: 0c8d72e1a3054b4db0a79e72a361c0be Sep 09 12:56:25.886528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-VolumesNegativeTest-758848789-project Sep 09 12:56:25.886528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: Sep 09 12:56:25.886528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Volume tempest-invalid-1904282386 could not be found. Sep 09 12:56:25.886528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'id': 'tempest-invalid-1904282386'} Sep 09 12:56:25.886528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:56:25.895282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:56:25.895282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:56:25.895282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:56:25.895282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 12:56:25.895282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 12:56:25.895282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 12:56:25.895282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 12:56:25.895282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 12:56:25.895282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 12:56:25.895282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 12:56:25.895282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 12:56:25.895282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:56:25.895282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:56:25.895282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:56:25.895282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:56:25.895282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1904282386 could not be found. (HTTP 404) (Request-ID: req-9aec84a0-e411-4c42-b333-59fc2744b3fd) Sep 09 12:56:25.895282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:25.895282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:56:25.895282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:25.896342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:56:25.896342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 12:56:25.896342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 12:56:25.896342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 12:56:25.896342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 12:56:25.896342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 12:56:25.896342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 12:56:25.896342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 12:56:25.896342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 12:56:25.896342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:56:25.896342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:56:25.896342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 12:56:25.896342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 12:56:25.896342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 12:56:25.896342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 12:56:25.896342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 12:56:25.896342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 12:56:25.896342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 12:56:25.896342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 12:56:25.897187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:56:25.897187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:56:25.897187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:56:25.897187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:56:25.897187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1904282386 could not be found. Sep 09 12:56:25.897187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:25.897187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:56:25.897187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:25.897187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:56:25.897187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:56:25.897187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:56:25.897187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:56:25.897187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:56:25.897187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:56:25.897187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:56:25.897187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:56:25.897187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:56:25.897187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 12:56:25.897187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:56:25.897187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1904282386 could not be found. Sep 09 12:56:25.898175 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:25.898175 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:56:25.898175 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:25.898175 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:56:25.898175 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:56:25.898175 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:56:25.898175 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:56:25.898175 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:56:25.898175 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1904282386 could not be found. Sep 09 12:56:25.898175 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:25.898175 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c56c8023-d582-412e-ba43-01d735d82c53 tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] Returning 404 to user: Volume tempest-invalid-1904282386 could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:56:25.898175 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-c56c8023-d582-412e-ba43-01d735d82c53 tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1904282386" status: 404 len: 99 microversion: 2.1 time: 1.691925 Sep 09 12:56:25.898175 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 3/5] 10.222.0.46 () {58 vars in 1218 bytes} [Fri Sep 9 12:56:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1904282386 => generated 99 bytes in 1693 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 09 12:56:25.902319 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-71e75695-e582-4654-8c7e-6a76f1f2c89f tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006373 Sep 09 12:56:25.903343 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 3/6] 10.222.0.46 () {58 vars in 1140 bytes} [Fri Sep 9 12:56:25 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 09 12:56:25.914000 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-36adbb1d-0439-4294-911d-0b417ebc0d46 tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004458 Sep 09 12:56:25.914711 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1137 bytes} [Fri Sep 9 12:56:25 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 09 12:56:25.933646 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a6c072af-6cef-4bc6-9eae-e8bdb8691193 tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] Calling method '.version_select at 0x7f3183f16af0>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:26.043698 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-a6c072af-6cef-4bc6-9eae-e8bdb8691193 tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] HTTP exception thrown: Volume 79de4311-62f8-47da-abe6-a7b4d54a2b4e could not be found. Sep 09 12:56:26.048133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a6c072af-6cef-4bc6-9eae-e8bdb8691193 tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] Request method failure captured: Sep 09 12:56:26.048133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: DELETE /compute/v2.1/os-volumes/79de4311-62f8-47da-abe6-a7b4d54a2b4e HTTP/1.1 Sep 09 12:56:26.048133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 12:56:26.048133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 12:56:26.048133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 12:56:26.048133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 12:56:26.048133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 12:56:26.048133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 12:56:26.048133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 12:56:26.048133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 12:56:26.048133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzf1wrD4UnAtBot4dyORXoElBupkJCM8oYeH9tBZ8xraY3KafwQ1I1krGauRDtzxyaaQpcHOkLglpKfUekZRALhYekyasCpqYQ3FRI2MX9B2PqFo60M8Bsat5f_ggajkaWlz-XZkGZ_FgfZV77g7QMRnOczw4kUcR-AzbKFYa1AWRM8 Sep 09 12:56:26.048133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 12:56:26.048133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 12:56:26.048133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 12:56:26.048133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 12:56:26.048133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 12:56:26.048133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 12:56:26.048133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: 3a03f8b7f17247c18fa91a7d64a98eb3 Sep 09 12:56:26.048133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-VolumesNegativeTest-758848789 Sep 09 12:56:26.048133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 12:56:26.048133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 12:56:26.049180 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3a03f8b7f17247c18fa91a7d64a98eb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3a03f8b7f17247c18fa91a7d64a98eb3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3a03f8b7f17247c18fa91a7d64a98eb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3a03f8b7f17247c18fa91a7d64a98eb3"}]}] Sep 09 12:56:26.049180 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-VolumesNegativeTest-758848789 Sep 09 12:56:26.049180 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: 3a03f8b7f17247c18fa91a7d64a98eb3 Sep 09 12:56:26.049180 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-VolumesNegativeTest-758848789 Sep 09 12:56:26.049180 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-VolumesNegativeTest-758848789-project Sep 09 12:56:26.049180 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 12:56:26.049180 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 12:56:26.049180 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 0c8d72e1a3054b4db0a79e72a361c0be Sep 09 12:56:26.049180 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-VolumesNegativeTest-758848789-project Sep 09 12:56:26.049180 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: Sep 09 12:56:26.049180 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Volume 79de4311-62f8-47da-abe6-a7b4d54a2b4e could not be found. Sep 09 12:56:26.049180 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': '79de4311-62f8-47da-abe6-a7b4d54a2b4e'} Sep 09 12:56:26.049180 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:56:26.049824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:56:26.049824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:56:26.049824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:56:26.049824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 12:56:26.049824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 12:56:26.049824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 12:56:26.049824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 12:56:26.049824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 12:56:26.049824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 12:56:26.049824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 12:56:26.049824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 12:56:26.049824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:56:26.049824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:56:26.049824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:56:26.049824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:56:26.049824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 79de4311-62f8-47da-abe6-a7b4d54a2b4e could not be found. (HTTP 404) (Request-ID: req-29912673-9109-4caf-93a6-f889b43b3bf1) Sep 09 12:56:26.049824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:56:26.049824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:56:26.049824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:56:26.051252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:56:26.051252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 12:56:26.051252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 12:56:26.051252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 12:56:26.051252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 12:56:26.051252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 12:56:26.051252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 12:56:26.051252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 12:56:26.051252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 12:56:26.051252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:56:26.051252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:56:26.051252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 12:56:26.051252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 12:56:26.051252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 12:56:26.051252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 12:56:26.051252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 12:56:26.051252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 12:56:26.051252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 12:56:26.051252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 12:56:26.052852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:56:26.052852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:56:26.052852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:56:26.052852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:56:26.052852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 79de4311-62f8-47da-abe6-a7b4d54a2b4e could not be found. Sep 09 12:56:26.052852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:56:26.052852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:56:26.052852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:56:26.052852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:56:26.052852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:56:26.052852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:56:26.052852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:56:26.052852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:56:26.052852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:56:26.052852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:56:26.052852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:56:26.052852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:56:26.052852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 12:56:26.052852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:56:26.056193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 79de4311-62f8-47da-abe6-a7b4d54a2b4e could not be found. Sep 09 12:56:26.056193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:56:26.056193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:56:26.056193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:56:26.056193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:56:26.056193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:56:26.056193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:56:26.056193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:56:26.056193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:56:26.056193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 79de4311-62f8-47da-abe6-a7b4d54a2b4e could not be found. Sep 09 12:56:26.056193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:56:26.056193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a6c072af-6cef-4bc6-9eae-e8bdb8691193 tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] Returning 404 to user: Volume 79de4311-62f8-47da-abe6-a7b4d54a2b4e could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:56:26.056193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-a6c072af-6cef-4bc6-9eae-e8bdb8691193 tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/79de4311-62f8-47da-abe6-a7b4d54a2b4e" status: 404 len: 109 microversion: 2.1 time: 0.130046 Sep 09 12:56:26.060565 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-90a6855c-0c61-4237-a667-2a1237027529 tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] Calling method '.version_select at 0x7f3183ebff70>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:26.064603 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1248 bytes} [Fri Sep 9 12:56:25 2022] DELETE /compute/v2.1/os-volumes/79de4311-62f8-47da-abe6-a7b4d54a2b4e => generated 109 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:56:26.157149 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-90a6855c-0c61-4237-a667-2a1237027529 tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] HTTP exception thrown: Volume 77a9004b-1769-4e0f-a05d-1f0b7e464a81 could not be found. Sep 09 12:56:26.162144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-90a6855c-0c61-4237-a667-2a1237027529 tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] Request method failure captured: Sep 09 12:56:26.162144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: GET /compute/v2.1/os-volumes/77a9004b-1769-4e0f-a05d-1f0b7e464a81 HTTP/1.1 Sep 09 12:56:26.162144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 12:56:26.162144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 12:56:26.162144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 12:56:26.162144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 12:56:26.162144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 12:56:26.162144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 12:56:26.162144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 12:56:26.162144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 12:56:26.162144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGzf1wrD4UnAtBot4dyORXoElBupkJCM8oYeH9tBZ8xraY3KafwQ1I1krGauRDtzxyaaQpcHOkLglpKfUekZRALhYekyasCpqYQ3FRI2MX9B2PqFo60M8Bsat5f_ggajkaWlz-XZkGZ_FgfZV77g7QMRnOczw4kUcR-AzbKFYa1AWRM8 Sep 09 12:56:26.162144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 12:56:26.162144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 12:56:26.162144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 12:56:26.162144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 12:56:26.162144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 12:56:26.162144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 12:56:26.162144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: 3a03f8b7f17247c18fa91a7d64a98eb3 Sep 09 12:56:26.162144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-VolumesNegativeTest-758848789 Sep 09 12:56:26.162144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 12:56:26.162144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 12:56:26.163363 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3a03f8b7f17247c18fa91a7d64a98eb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3a03f8b7f17247c18fa91a7d64a98eb3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3a03f8b7f17247c18fa91a7d64a98eb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3a03f8b7f17247c18fa91a7d64a98eb3"}]}] Sep 09 12:56:26.163363 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-VolumesNegativeTest-758848789 Sep 09 12:56:26.163363 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: 3a03f8b7f17247c18fa91a7d64a98eb3 Sep 09 12:56:26.163363 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-VolumesNegativeTest-758848789 Sep 09 12:56:26.163363 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-VolumesNegativeTest-758848789-project Sep 09 12:56:26.163363 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 12:56:26.163363 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 12:56:26.163363 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: 0c8d72e1a3054b4db0a79e72a361c0be Sep 09 12:56:26.163363 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-VolumesNegativeTest-758848789-project Sep 09 12:56:26.163363 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: Sep 09 12:56:26.163363 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Volume 77a9004b-1769-4e0f-a05d-1f0b7e464a81 could not be found. Sep 09 12:56:26.163363 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'id': '77a9004b-1769-4e0f-a05d-1f0b7e464a81'} Sep 09 12:56:26.163363 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:56:26.163957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:56:26.163957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:56:26.163957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:56:26.163957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 12:56:26.163957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 12:56:26.163957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 12:56:26.163957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 12:56:26.163957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 12:56:26.163957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 12:56:26.163957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 12:56:26.163957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 12:56:26.163957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:56:26.163957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:56:26.163957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:56:26.163957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:56:26.163957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77a9004b-1769-4e0f-a05d-1f0b7e464a81 could not be found. (HTTP 404) (Request-ID: req-49c07c01-f7a6-4946-8b3a-2d14d0629bb0) Sep 09 12:56:26.163957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:26.163957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:56:26.163957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:26.164791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:56:26.164791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 12:56:26.164791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 12:56:26.164791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 12:56:26.164791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 12:56:26.164791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 12:56:26.164791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 12:56:26.164791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 12:56:26.164791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 12:56:26.164791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:56:26.164791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:56:26.164791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 12:56:26.164791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 12:56:26.164791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 12:56:26.164791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 12:56:26.164791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 12:56:26.164791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 12:56:26.164791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 12:56:26.164791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 12:56:26.165741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:56:26.165741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:56:26.165741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:56:26.165741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:56:26.165741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77a9004b-1769-4e0f-a05d-1f0b7e464a81 could not be found. Sep 09 12:56:26.165741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:26.165741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:56:26.165741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:26.165741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:56:26.165741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:56:26.165741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:56:26.165741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:56:26.165741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:56:26.165741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:56:26.165741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:56:26.165741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:56:26.165741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:56:26.165741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 12:56:26.165741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:56:26.166630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77a9004b-1769-4e0f-a05d-1f0b7e464a81 could not be found. Sep 09 12:56:26.166630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:26.166630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:56:26.166630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:26.166630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:56:26.166630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:56:26.166630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:56:26.166630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:56:26.166630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:56:26.166630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77a9004b-1769-4e0f-a05d-1f0b7e464a81 could not be found. Sep 09 12:56:26.166630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:56:26.166630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-90a6855c-0c61-4237-a667-2a1237027529 tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] Returning 404 to user: Volume 77a9004b-1769-4e0f-a05d-1f0b7e464a81 could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:56:26.166630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-90a6855c-0c61-4237-a667-2a1237027529 tempest-VolumesNegativeTest-758848789 tempest-VolumesNegativeTest-758848789-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/77a9004b-1769-4e0f-a05d-1f0b7e464a81" status: 404 len: 109 microversion: 2.1 time: 0.107127 Sep 09 12:56:26.166630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 5/9] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 12:56:26 2022] GET /compute/v2.1/os-volumes/77a9004b-1769-4e0f-a05d-1f0b7e464a81 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:56:27.154950 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e7bab40a-884b-4d92-be6f-7e125cb3ef43 tempest-VolumesTestJSON-1643515077 tempest-VolumesTestJSON-1643515077-project] Calling method '.version_select at 0x7f3183eaf040>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:27.360158 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-e7bab40a-884b-4d92-be6f-7e125cb3ef43 tempest-VolumesTestJSON-1643515077 tempest-VolumesTestJSON-1643515077-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/5ee4048f-8988-4faa-ae06-323ea8643f7a" status: 200 len: 350 microversion: 2.1 time: 0.209626 Sep 09 12:56:27.375479 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 5/10] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 12:56:27 2022] GET /compute/v2.1/os-volumes/5ee4048f-8988-4faa-ae06-323ea8643f7a => generated 350 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:56:29.629691 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e65464e9-96cd-499b-921f-8cc9a7dfdce8 tempest-VolumesTestJSON-1643515077 tempest-VolumesTestJSON-1643515077-project] Calling method '.version_select at 0x7f3183ebf8b0>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:29.703970 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e65464e9-96cd-499b-921f-8cc9a7dfdce8 tempest-VolumesTestJSON-1643515077 tempest-VolumesTestJSON-1643515077-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/cbcc0439-23ce-41f4-84f8-c411ee211930" status: 200 len: 351 microversion: 2.1 time: 0.079529 Sep 09 12:56:29.704680 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 6/11] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 12:56:29 2022] GET /compute/v2.1/os-volumes/cbcc0439-23ce-41f4-84f8-c411ee211930 => generated 351 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:56:29.718674 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e16cd0f1-2a31-4a3d-b385-99f45dff73fc tempest-VolumesTestJSON-1643515077 tempest-VolumesTestJSON-1643515077-project] Calling method '.version_select at 0x7f3183e78670>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:29.957026 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-e16cd0f1-2a31-4a3d-b385-99f45dff73fc tempest-VolumesTestJSON-1643515077 tempest-VolumesTestJSON-1643515077-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.241992 Sep 09 12:56:29.957852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 6/12] 10.222.0.46 () {58 vars in 1134 bytes} [Fri Sep 9 12:56:29 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:29.979122 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-b037d6ae-9e65-4810-9876-6dd22a9034f4 tempest-VolumesTestJSON-1643515077 tempest-VolumesTestJSON-1643515077-project] Calling method '.version_select at 0x7f3183e6c550>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:30.091651 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-b037d6ae-9e65-4810-9876-6dd22a9034f4 tempest-VolumesTestJSON-1643515077 tempest-VolumesTestJSON-1643515077-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.119565 Sep 09 12:56:30.105140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1149 bytes} [Fri Sep 9 12:56:29 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:56:30.110932 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-27af2012-6b93-4f21-a56c-ce58c7f1f1cb tempest-VolumesTestJSON-1643515077 tempest-VolumesTestJSON-1643515077-project] Calling method '.version_select at 0x7f3183e78790>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:30.259688 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-27af2012-6b93-4f21-a56c-ce58c7f1f1cb tempest-VolumesTestJSON-1643515077 tempest-VolumesTestJSON-1643515077-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.152961 Sep 09 12:56:30.265554 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 7/14] 10.222.0.46 () {58 vars in 1134 bytes} [Fri Sep 9 12:56:30 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:30.288808 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-9d9c3451-05b5-4c1d-92a7-8479b170170b tempest-VolumesTestJSON-1643515077 tempest-VolumesTestJSON-1643515077-project] Calling method '.version_select at 0x7f3183e74820>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:30.465293 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-9d9c3451-05b5-4c1d-92a7-8479b170170b tempest-VolumesTestJSON-1643515077 tempest-VolumesTestJSON-1643515077-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.179986 Sep 09 12:56:30.466475 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 8/15] 10.222.0.46 () {58 vars in 1167 bytes} [Fri Sep 9 12:56:30 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:56:30.485557 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2235d81f-f0d5-40f0-ad34-697baa97bfcd tempest-VolumesTestJSON-1643515077 tempest-VolumesTestJSON-1643515077-project] Calling method '.version_select at 0x7f31848b4790>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:30.703740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2235d81f-f0d5-40f0-ad34-697baa97bfcd tempest-VolumesTestJSON-1643515077 tempest-VolumesTestJSON-1643515077-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.222387 Sep 09 12:56:30.714728 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 8/16] 10.222.0.46 () {58 vars in 1170 bytes} [Fri Sep 9 12:56:30 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:56:30.727133 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-5f7128c7-8163-4530-a42b-ebbfc46c1e0b tempest-VolumesTestJSON-1643515077 tempest-VolumesTestJSON-1643515077-project] Calling method '.version_select at 0x7f3183e748b0>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:30.944355 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-5f7128c7-8163-4530-a42b-ebbfc46c1e0b tempest-VolumesTestJSON-1643515077 tempest-VolumesTestJSON-1643515077-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.222709 Sep 09 12:56:30.944355 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 9/17] 10.222.0.46 () {58 vars in 1155 bytes} [Fri Sep 9 12:56:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:30.959193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e122a1c6-742d-46d1-a1b1-9f9d0a57aa7e tempest-VolumesTestJSON-1643515077 tempest-VolumesTestJSON-1643515077-project] Calling method '.version_select at 0x7f3183f26e50>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:31.080901 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-e122a1c6-742d-46d1-a1b1-9f9d0a57aa7e tempest-VolumesTestJSON-1643515077 tempest-VolumesTestJSON-1643515077-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.125812 Sep 09 12:56:31.083458 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 9/18] 10.222.0.46 () {58 vars in 1188 bytes} [Fri Sep 9 12:56:30 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:56:31.100114 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-bd9be16b-7d1a-4594-8a90-77759ad0b0bb tempest-VolumesTestJSON-1643515077 tempest-VolumesTestJSON-1643515077-project] Calling method '.version_select at 0x7f3183e6c1f0>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:31.211285 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-bd9be16b-7d1a-4594-8a90-77759ad0b0bb tempest-VolumesTestJSON-1643515077 tempest-VolumesTestJSON-1643515077-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.115712 Sep 09 12:56:31.212111 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 10/19] 10.222.0.46 () {58 vars in 1155 bytes} [Fri Sep 9 12:56:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:37.241096 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-abe65c32-6554-41dc-a436-e04c5f1fa08b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1772114428", "imageRef": "355bded2-2225-44b2-af86-f9e1861d05ff", "flavorRef": "452", "networks": [{"uuid": "82bf82db-bb9b-43d0-b400-ae15aab13b67"}]}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:56:37.453449 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.network.neutron [None req-abe65c32-6554-41dc-a436-e04c5f1fa08b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] validate_networks() for [('82bf82db-bb9b-43d0-b400-ae15aab13b67', None, None, None, None, None)] {{(pid=127771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:56:37.713174 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-0668f4e1-d27d-48a3-9859-2bb8910a48f5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Action: 'create', calling method: .version_select at 0x7f3183ebf820>, body: {"keypair": {"name": "tempest-keypair-1609297797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2+zZlQRGV+lUcaMtmXy2q89ACkAXgrtaPNR6rZqciJiQPUodAd64/UC0nUF2Jv6vhEBzLT4IYRudPv3PpRKTmECqmFzebQdqoSt74acz03Ayz9YvAQUD7lmZdSzdOUcg=="}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:56:37.834911 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-0668f4e1-d27d-48a3-9859-2bb8910a48f5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Getting quotas for project ceed6a1f0f4542cbafa4b2a46b16d5fb. Resources: {'key_pairs'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:56:37.853857 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-0668f4e1-d27d-48a3-9859-2bb8910a48f5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Getting quotas for user 63a2902f465f4fd1aed80060c2669259 and project ceed6a1f0f4542cbafa4b2a46b16d5fb. Resources: {'key_pairs'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:56:38.064913 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-0668f4e1-d27d-48a3-9859-2bb8910a48f5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.869081 Sep 09 12:56:38.073742 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1159 bytes} [Fri Sep 9 12:56:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:56:39.618150 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ef644a03-65e7-4bc4-9951-3ce1faef833c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Action: 'create', calling method: .version_select at 0x7f3183e3f670>, body: {"keypair": {"name": "tempest-keypair-1378395883", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/lXoqphB40Vslu+OSzrIIbgBo9tQO4OHyIoelnxZuwZXs2qKBIgFI2KrYm+b0qseUf4cZ+JCMW1OGw52nIJOb0dI5CxIOYNBL/o0+0IQhoKUDC/+y3IR54Qy59Ds3kzw=="}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:56:39.656763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-ef644a03-65e7-4bc4-9951-3ce1faef833c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Getting quotas for project 8880382269b94daa8a25f92178a478d5. Resources: {'key_pairs'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:56:39.664894 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-ef644a03-65e7-4bc4-9951-3ce1faef833c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Getting quotas for user 6ec951604cde4768beb02906caf6d7c2 and project 8880382269b94daa8a25f92178a478d5. Resources: {'key_pairs'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:56:39.816922 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-ef644a03-65e7-4bc4-9951-3ce1faef833c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.356528 Sep 09 12:56:39.817740 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 12/21] 10.222.0.46 () {62 vars in 1200 bytes} [Fri Sep 9 12:56:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1358 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 09 12:56:41.690407 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-abe65c32-6554-41dc-a436-e04c5f1fa08b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Flavor limits 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:56:41.690998 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-abe65c32-6554-41dc-a436-e04c5f1fa08b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Image limits 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:56:41.691366 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-abe65c32-6554-41dc-a436-e04c5f1fa08b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Flavor pref 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:56:41.692559 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-abe65c32-6554-41dc-a436-e04c5f1fa08b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Image pref 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:56:41.692982 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-abe65c32-6554-41dc-a436-e04c5f1fa08b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:56:41.745100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-abe65c32-6554-41dc-a436-e04c5f1fa08b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:41.745675 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-abe65c32-6554-41dc-a436-e04c5f1fa08b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:41.746132 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-abe65c32-6554-41dc-a436-e04c5f1fa08b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:41.746946 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-abe65c32-6554-41dc-a436-e04c5f1fa08b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:41.747404 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-abe65c32-6554-41dc-a436-e04c5f1fa08b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:41.753831 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-abe65c32-6554-41dc-a436-e04c5f1fa08b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:41.859866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-abe65c32-6554-41dc-a436-e04c5f1fa08b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Getting quotas for project 9c2a31fedb6843ba8ffea570a374acf5. Resources: {'instances', 'cores', 'ram'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:56:41.868607 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-abe65c32-6554-41dc-a436-e04c5f1fa08b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Getting quotas for user c71eb53fc47c4f82add6fdd3d469230e and project 9c2a31fedb6843ba8ffea570a374acf5. Resources: {'instances', 'cores', 'ram'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:56:41.884038 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-abe65c32-6554-41dc-a436-e04c5f1fa08b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Going to run 1 instances... {{(pid=127771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:56:41.887335 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-abe65c32-6554-41dc-a436-e04c5f1fa08b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='355bded2-2225-44b2-af86-f9e1861d05ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:56:42.262843 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-abe65c32-6554-41dc-a436-e04c5f1fa08b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.473059 Sep 09 12:56:42.265164 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 10/22] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 12:56:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 5484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:56:42.279976 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7c26b388-a4d7-46b1-bbb3-1cc68ef2333d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:42.281615 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7c26b388-a4d7-46b1-bbb3-1cc68ef2333d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:42.535518 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7c26b388-a4d7-46b1-bbb3-1cc68ef2333d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:42.562064 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7c26b388-a4d7-46b1-bbb3-1cc68ef2333d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1215 microversion: 2.1 time: 0.287116 Sep 09 12:56:42.563159 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 13/23] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:42 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1215 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:43.589041 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-98fc59de-df0e-41f5-a83e-57be2f06526c tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:43.590304 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-98fc59de-df0e-41f5-a83e-57be2f06526c tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:44.000556 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-98fc59de-df0e-41f5-a83e-57be2f06526c tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:44.078565 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-98fc59de-df0e-41f5-a83e-57be2f06526c tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1215 microversion: 2.1 time: 0.493744 Sep 09 12:56:44.093785 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 11/24] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:43 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1215 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:56:44.125372 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-d427b254-a558-45dd-a6ef-0b5037970218 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-814350703", "imageRef": "355bded2-2225-44b2-af86-f9e1861d05ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4f411e2-e42e-4ab3-86d3-b0b098a1a8fe"}], "security_groups": [{"name": "tempest-securitygroup--1852347791"}], "key_name": "tempest-keypair-1609297797", "user_data": "}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:56:44.425338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.network.neutron [None req-d427b254-a558-45dd-a6ef-0b5037970218 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] validate_networks() for [('c4f411e2-e42e-4ab3-86d3-b0b098a1a8fe', None, None, None, None, None)] {{(pid=127772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:56:45.123070 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-1c684a3c-2651-4a21-94f1-85a099fb382f tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:45.125724 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-1c684a3c-2651-4a21-94f1-85a099fb382f tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:45.230473 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-1c684a3c-2651-4a21-94f1-85a099fb382f tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:45.240935 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-1c684a3c-2651-4a21-94f1-85a099fb382f tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1215 microversion: 2.1 time: 0.126417 Sep 09 12:56:45.242347 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 12/25] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:45 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1215 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:56:45.479810 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-d427b254-a558-45dd-a6ef-0b5037970218 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Flavor limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:56:45.480735 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-d427b254-a558-45dd-a6ef-0b5037970218 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Image limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:56:45.481515 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-d427b254-a558-45dd-a6ef-0b5037970218 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Flavor pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:56:45.481989 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-d427b254-a558-45dd-a6ef-0b5037970218 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Image pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:56:45.482754 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-d427b254-a558-45dd-a6ef-0b5037970218 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:56:45.516576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d427b254-a558-45dd-a6ef-0b5037970218 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:45.516576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d427b254-a558-45dd-a6ef-0b5037970218 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:45.519892 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d427b254-a558-45dd-a6ef-0b5037970218 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:45.522985 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d427b254-a558-45dd-a6ef-0b5037970218 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:45.523646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d427b254-a558-45dd-a6ef-0b5037970218 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:45.524446 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d427b254-a558-45dd-a6ef-0b5037970218 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:45.553354 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-d427b254-a558-45dd-a6ef-0b5037970218 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Getting quotas for project ceed6a1f0f4542cbafa4b2a46b16d5fb. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:56:45.558986 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-d427b254-a558-45dd-a6ef-0b5037970218 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Getting quotas for user 63a2902f465f4fd1aed80060c2669259 and project ceed6a1f0f4542cbafa4b2a46b16d5fb. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:56:45.574994 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-d427b254-a558-45dd-a6ef-0b5037970218 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Going to run 1 instances... {{(pid=127772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:56:45.578457 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-d427b254-a558-45dd-a6ef-0b5037970218 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='355bded2-2225-44b2-af86-f9e1861d05ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:56:45.742295 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-d427b254-a558-45dd-a6ef-0b5037970218 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.622619 Sep 09 12:56:45.743176 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 14/26] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 12:56:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:56:45.756579 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-c7d90ccf-065c-4e29-8023-4149e654cce1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:45.759992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-c7d90ccf-065c-4e29-8023-4149e654cce1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:45.862176 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-c7d90ccf-065c-4e29-8023-4149e654cce1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:45.876101 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-c7d90ccf-065c-4e29-8023-4149e654cce1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1241 microversion: 2.1 time: 0.125127 Sep 09 12:56:45.877305 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 13/27] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:45 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1241 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:46.265000 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c3002a3a-ef7a-41a5-8c39-311196da615d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:46.268853 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-c3002a3a-ef7a-41a5-8c39-311196da615d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:46.300374 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c3002a3a-ef7a-41a5-8c39-311196da615d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:46.300374 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c3002a3a-ef7a-41a5-8c39-311196da615d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:46.300374 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c3002a3a-ef7a-41a5-8c39-311196da615d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:46.300374 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c3002a3a-ef7a-41a5-8c39-311196da615d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:46.300849 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c3002a3a-ef7a-41a5-8c39-311196da615d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:46.300849 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c3002a3a-ef7a-41a5-8c39-311196da615d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:46.507153 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-06d7089e-d2b4-40b6-b05d-0ba99def4ed6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-453594063", "imageRef": "355bded2-2225-44b2-af86-f9e1861d05ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a798d8ea-1c3e-491f-9557-82b8ebb58c2c"}], "security_groups": [{"name": "tempest-securitygroup--1975525490"}], "key_name": "tempest-keypair-1378395883", "user_data": "}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:56:46.659654 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c3002a3a-ef7a-41a5-8c39-311196da615d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:46.704375 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-c3002a3a-ef7a-41a5-8c39-311196da615d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1211 microversion: 2.1 time: 0.443889 Sep 09 12:56:46.705524 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 15/28] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:46 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1211 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:46.766372 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.network.neutron [None req-06d7089e-d2b4-40b6-b05d-0ba99def4ed6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] validate_networks() for [('a798d8ea-1c3e-491f-9557-82b8ebb58c2c', None, None, None, None, None)] {{(pid=127771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:56:46.904294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-3450bbc6-74c0-4a04-b629-dd460348ed45 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:46.906052 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-3450bbc6-74c0-4a04-b629-dd460348ed45 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:47.180209 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-3450bbc6-74c0-4a04-b629-dd460348ed45 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:47.180209 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-3450bbc6-74c0-4a04-b629-dd460348ed45 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1241 microversion: 2.1 time: 0.255764 Sep 09 12:56:47.180209 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 16/29] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:46 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1241 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:47.413480 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-06d7089e-d2b4-40b6-b05d-0ba99def4ed6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Flavor limits 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:56:47.413915 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-06d7089e-d2b4-40b6-b05d-0ba99def4ed6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Image limits 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:56:47.414400 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-06d7089e-d2b4-40b6-b05d-0ba99def4ed6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Flavor pref 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:56:47.416083 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-06d7089e-d2b4-40b6-b05d-0ba99def4ed6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Image pref 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:56:47.416519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-06d7089e-d2b4-40b6-b05d-0ba99def4ed6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:56:47.435130 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-06d7089e-d2b4-40b6-b05d-0ba99def4ed6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:47.437910 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-06d7089e-d2b4-40b6-b05d-0ba99def4ed6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:47.438421 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-06d7089e-d2b4-40b6-b05d-0ba99def4ed6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:47.439266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-06d7089e-d2b4-40b6-b05d-0ba99def4ed6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:47.439742 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-06d7089e-d2b4-40b6-b05d-0ba99def4ed6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:47.440234 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-06d7089e-d2b4-40b6-b05d-0ba99def4ed6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:47.478182 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-06d7089e-d2b4-40b6-b05d-0ba99def4ed6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Getting quotas for project 8880382269b94daa8a25f92178a478d5. Resources: {'instances', 'cores', 'ram'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:56:47.483316 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-06d7089e-d2b4-40b6-b05d-0ba99def4ed6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Getting quotas for user 6ec951604cde4768beb02906caf6d7c2 and project 8880382269b94daa8a25f92178a478d5. Resources: {'instances', 'cores', 'ram'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:56:47.515154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-06d7089e-d2b4-40b6-b05d-0ba99def4ed6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Going to run 1 instances... {{(pid=127771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:56:47.520541 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-06d7089e-d2b4-40b6-b05d-0ba99def4ed6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='355bded2-2225-44b2-af86-f9e1861d05ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:56:47.714202 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-06d7089e-d2b4-40b6-b05d-0ba99def4ed6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.211271 Sep 09 12:56:47.724577 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 14/30] 10.222.0.46 () {62 vars in 1188 bytes} [Fri Sep 9 12:56:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 09 12:56:47.731195 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-8111e9d4-dc98-4b88-8c76-8d83ee7363e0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:47.732943 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-8111e9d4-dc98-4b88-8c76-8d83ee7363e0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:47.744215 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-f8a40d1b-486e-4448-997f-372b9f47308a tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:47.747506 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-f8a40d1b-486e-4448-997f-372b9f47308a tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:47.769943 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f8a40d1b-486e-4448-997f-372b9f47308a tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:47.770531 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f8a40d1b-486e-4448-997f-372b9f47308a tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:47.770992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f8a40d1b-486e-4448-997f-372b9f47308a tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:47.771772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f8a40d1b-486e-4448-997f-372b9f47308a tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:47.773547 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f8a40d1b-486e-4448-997f-372b9f47308a tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:47.774006 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f8a40d1b-486e-4448-997f-372b9f47308a tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:47.901666 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-8111e9d4-dc98-4b88-8c76-8d83ee7363e0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:47.935371 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-8111e9d4-dc98-4b88-8c76-8d83ee7363e0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:47.949220 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-8111e9d4-dc98-4b88-8c76-8d83ee7363e0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:47.951322 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-8111e9d4-dc98-4b88-8c76-8d83ee7363e0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1281 microversion: 2.20 time: 0.227156 Sep 09 12:56:47.969977 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 17/31] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:56:47 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1281 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:56:48.106236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-f8a40d1b-486e-4448-997f-372b9f47308a tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:48.119362 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-f8a40d1b-486e-4448-997f-372b9f47308a tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1275 microversion: 2.1 time: 0.388466 Sep 09 12:56:48.120606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 15/32] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:47 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1275 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:48.183495 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-652dffa4-d223-457c-8200-3615ed65ded9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:48.183495 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-652dffa4-d223-457c-8200-3615ed65ded9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:48.262333 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-652dffa4-d223-457c-8200-3615ed65ded9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:48.269340 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-652dffa4-d223-457c-8200-3615ed65ded9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1241 microversion: 2.1 time: 0.091806 Sep 09 12:56:48.270671 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 18/33] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:48 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:56:48.987715 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-6f924ff2-40a8-40bd-bb7f-93b7a913c183 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:48.988479 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-6f924ff2-40a8-40bd-bb7f-93b7a913c183 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:49.072381 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-6f924ff2-40a8-40bd-bb7f-93b7a913c183 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:49.090694 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-6f924ff2-40a8-40bd-bb7f-93b7a913c183 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:49.092425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-6f924ff2-40a8-40bd-bb7f-93b7a913c183 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:49.094381 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-6f924ff2-40a8-40bd-bb7f-93b7a913c183 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1281 microversion: 2.20 time: 0.118195 Sep 09 12:56:49.096454 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 16/34] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:56:48 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1281 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:56:49.156856 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-b6df5f8d-157e-4dd3-a778-45939e83702f tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:49.157486 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-b6df5f8d-157e-4dd3-a778-45939e83702f tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:49.168608 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b6df5f8d-157e-4dd3-a778-45939e83702f tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:49.169970 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b6df5f8d-157e-4dd3-a778-45939e83702f tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:49.170524 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b6df5f8d-157e-4dd3-a778-45939e83702f tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:49.171273 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b6df5f8d-157e-4dd3-a778-45939e83702f tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:49.171745 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b6df5f8d-157e-4dd3-a778-45939e83702f tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:49.175299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b6df5f8d-157e-4dd3-a778-45939e83702f tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:49.270692 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-b6df5f8d-157e-4dd3-a778-45939e83702f tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:49.280270 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-b6df5f8d-157e-4dd3-a778-45939e83702f tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1285 microversion: 2.1 time: 0.136579 Sep 09 12:56:49.280854 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 19/35] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:49 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:49.295144 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-db47e628-9371-4d3a-a65e-1a3df8c175bc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:49.298637 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-db47e628-9371-4d3a-a65e-1a3df8c175bc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:49.302807 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-db47e628-9371-4d3a-a65e-1a3df8c175bc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:49.303549 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-db47e628-9371-4d3a-a65e-1a3df8c175bc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:49.304156 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-db47e628-9371-4d3a-a65e-1a3df8c175bc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:49.304872 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-db47e628-9371-4d3a-a65e-1a3df8c175bc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:49.305636 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-db47e628-9371-4d3a-a65e-1a3df8c175bc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:49.306065 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-db47e628-9371-4d3a-a65e-1a3df8c175bc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:49.375773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-db47e628-9371-4d3a-a65e-1a3df8c175bc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:49.385684 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-db47e628-9371-4d3a-a65e-1a3df8c175bc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1245 microversion: 2.1 time: 0.094600 Sep 09 12:56:49.386561 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 17/36] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:49 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:50.122083 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-d8d212bb-9ef2-4425-90a3-76b7e23addda tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:50.125007 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-d8d212bb-9ef2-4425-90a3-76b7e23addda tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:50.132044 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d8d212bb-9ef2-4425-90a3-76b7e23addda tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:50.132691 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d8d212bb-9ef2-4425-90a3-76b7e23addda tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:50.133204 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d8d212bb-9ef2-4425-90a3-76b7e23addda tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:50.133986 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d8d212bb-9ef2-4425-90a3-76b7e23addda tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:50.134616 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d8d212bb-9ef2-4425-90a3-76b7e23addda tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:50.135442 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d8d212bb-9ef2-4425-90a3-76b7e23addda tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:50.201846 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-d8d212bb-9ef2-4425-90a3-76b7e23addda tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:50.211870 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-d8d212bb-9ef2-4425-90a3-76b7e23addda tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:50.213521 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-d8d212bb-9ef2-4425-90a3-76b7e23addda tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:50.217429 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-d8d212bb-9ef2-4425-90a3-76b7e23addda tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1285 microversion: 2.20 time: 0.097241 Sep 09 12:56:50.217429 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 20/37] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:56:50 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:56:50.310789 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-146673c2-721c-4aaf-8f3c-61ad28186a38 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:50.312907 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-146673c2-721c-4aaf-8f3c-61ad28186a38 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:50.327571 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-146673c2-721c-4aaf-8f3c-61ad28186a38 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:50.327571 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-146673c2-721c-4aaf-8f3c-61ad28186a38 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:50.327571 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-146673c2-721c-4aaf-8f3c-61ad28186a38 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:50.327993 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-146673c2-721c-4aaf-8f3c-61ad28186a38 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:50.328606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-146673c2-721c-4aaf-8f3c-61ad28186a38 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:50.329180 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-146673c2-721c-4aaf-8f3c-61ad28186a38 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:50.413967 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-9b3052dc-1772-4986-be66-08ceb8d2d712 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:50.415207 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-9b3052dc-1772-4986-be66-08ceb8d2d712 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:50.423571 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9b3052dc-1772-4986-be66-08ceb8d2d712 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:50.426246 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9b3052dc-1772-4986-be66-08ceb8d2d712 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:50.427238 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9b3052dc-1772-4986-be66-08ceb8d2d712 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:50.428294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9b3052dc-1772-4986-be66-08ceb8d2d712 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:50.429230 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9b3052dc-1772-4986-be66-08ceb8d2d712 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:50.429683 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9b3052dc-1772-4986-be66-08ceb8d2d712 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:50.447609 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-146673c2-721c-4aaf-8f3c-61ad28186a38 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:50.461492 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-146673c2-721c-4aaf-8f3c-61ad28186a38 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1285 microversion: 2.1 time: 0.154835 Sep 09 12:56:50.463853 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 18/38] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:50 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:50.566956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-9b3052dc-1772-4986-be66-08ceb8d2d712 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:50.575381 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-9b3052dc-1772-4986-be66-08ceb8d2d712 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1245 microversion: 2.1 time: 0.169571 Sep 09 12:56:50.580152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 21/39] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:50 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1245 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:56:51.242430 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a1282d01-fcfa-4d36-85c9-50e422f38129 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:51.243400 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-a1282d01-fcfa-4d36-85c9-50e422f38129 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:51.256101 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a1282d01-fcfa-4d36-85c9-50e422f38129 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:51.256885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a1282d01-fcfa-4d36-85c9-50e422f38129 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:51.257471 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a1282d01-fcfa-4d36-85c9-50e422f38129 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:51.258428 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a1282d01-fcfa-4d36-85c9-50e422f38129 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:51.259217 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a1282d01-fcfa-4d36-85c9-50e422f38129 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:51.259993 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a1282d01-fcfa-4d36-85c9-50e422f38129 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:51.415140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-a1282d01-fcfa-4d36-85c9-50e422f38129 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:51.430807 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-a1282d01-fcfa-4d36-85c9-50e422f38129 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:51.435887 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-a1282d01-fcfa-4d36-85c9-50e422f38129 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:51.442990 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-a1282d01-fcfa-4d36-85c9-50e422f38129 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1277 microversion: 2.20 time: 0.201868 Sep 09 12:56:51.444269 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 19/40] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:56:51 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1277 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:56:51.493180 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-47efb51c-9116-4b63-b328-eab127f7493b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:51.494308 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-47efb51c-9116-4b63-b328-eab127f7493b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:51.504276 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-47efb51c-9116-4b63-b328-eab127f7493b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:51.504951 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-47efb51c-9116-4b63-b328-eab127f7493b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:51.505739 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-47efb51c-9116-4b63-b328-eab127f7493b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:51.506771 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-47efb51c-9116-4b63-b328-eab127f7493b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:51.507891 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-47efb51c-9116-4b63-b328-eab127f7493b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:51.508493 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-47efb51c-9116-4b63-b328-eab127f7493b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:51.602112 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-96600f5f-9ee9-4b4d-8aa8-76a99be092e2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:51.602880 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-96600f5f-9ee9-4b4d-8aa8-76a99be092e2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:51.614723 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-96600f5f-9ee9-4b4d-8aa8-76a99be092e2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:51.620620 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-96600f5f-9ee9-4b4d-8aa8-76a99be092e2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:51.620620 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-96600f5f-9ee9-4b4d-8aa8-76a99be092e2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:51.620620 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-96600f5f-9ee9-4b4d-8aa8-76a99be092e2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:51.620620 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-96600f5f-9ee9-4b4d-8aa8-76a99be092e2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:51.621088 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-96600f5f-9ee9-4b4d-8aa8-76a99be092e2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:51.653055 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-47efb51c-9116-4b63-b328-eab127f7493b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:51.670066 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-47efb51c-9116-4b63-b328-eab127f7493b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1273 microversion: 2.1 time: 0.184217 Sep 09 12:56:51.671329 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 22/41] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:51 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1273 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:51.746972 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-96600f5f-9ee9-4b4d-8aa8-76a99be092e2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:51.756734 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-96600f5f-9ee9-4b4d-8aa8-76a99be092e2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1293 microversion: 2.1 time: 0.160385 Sep 09 12:56:51.759428 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 20/42] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:51 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1293 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:56:52.488698 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-afd93631-0d9e-4312-b4fc-ae0fabf88b05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:52.488698 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-afd93631-0d9e-4312-b4fc-ae0fabf88b05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:52.489670 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-afd93631-0d9e-4312-b4fc-ae0fabf88b05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:52.498951 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-afd93631-0d9e-4312-b4fc-ae0fabf88b05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:52.500193 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-afd93631-0d9e-4312-b4fc-ae0fabf88b05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:52.501053 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-afd93631-0d9e-4312-b4fc-ae0fabf88b05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:52.501586 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-afd93631-0d9e-4312-b4fc-ae0fabf88b05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:52.502177 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-afd93631-0d9e-4312-b4fc-ae0fabf88b05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:52.639984 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-afd93631-0d9e-4312-b4fc-ae0fabf88b05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:52.660164 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-afd93631-0d9e-4312-b4fc-ae0fabf88b05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:52.676279 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-afd93631-0d9e-4312-b4fc-ae0fabf88b05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:52.676279 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-afd93631-0d9e-4312-b4fc-ae0fabf88b05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1277 microversion: 2.20 time: 0.191778 Sep 09 12:56:52.679072 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 23/43] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:56:52 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1277 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:56:52.711539 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-4c6ea32d-1b0d-49dc-b440-51747ec08d0d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:52.715326 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-4c6ea32d-1b0d-49dc-b440-51747ec08d0d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:52.744106 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4c6ea32d-1b0d-49dc-b440-51747ec08d0d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:52.745061 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4c6ea32d-1b0d-49dc-b440-51747ec08d0d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:52.746128 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4c6ea32d-1b0d-49dc-b440-51747ec08d0d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:52.746907 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4c6ea32d-1b0d-49dc-b440-51747ec08d0d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:52.747373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4c6ea32d-1b0d-49dc-b440-51747ec08d0d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:52.763265 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4c6ea32d-1b0d-49dc-b440-51747ec08d0d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:52.786713 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c24d3a6a-2656-4793-a8f2-a2424255feba tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:52.787259 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-c24d3a6a-2656-4793-a8f2-a2424255feba tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:52.805195 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c24d3a6a-2656-4793-a8f2-a2424255feba tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:52.805771 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c24d3a6a-2656-4793-a8f2-a2424255feba tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:52.806343 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c24d3a6a-2656-4793-a8f2-a2424255feba tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:52.807228 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c24d3a6a-2656-4793-a8f2-a2424255feba tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:52.807693 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c24d3a6a-2656-4793-a8f2-a2424255feba tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:52.808204 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c24d3a6a-2656-4793-a8f2-a2424255feba tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:52.931420 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c24d3a6a-2656-4793-a8f2-a2424255feba tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:52.946035 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-c24d3a6a-2656-4793-a8f2-a2424255feba tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1293 microversion: 2.1 time: 0.165302 Sep 09 12:56:52.946619 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 24/44] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:52 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1293 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:53.196413 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-4c6ea32d-1b0d-49dc-b440-51747ec08d0d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:53.208246 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-4c6ea32d-1b0d-49dc-b440-51747ec08d0d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1315 microversion: 2.1 time: 0.506194 Sep 09 12:56:53.230518 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 21/45] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:52 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1315 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:53.726472 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-25e68cc0-c64e-4df8-bd06-dec53fc53ad7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:53.726472 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-25e68cc0-c64e-4df8-bd06-dec53fc53ad7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:53.726472 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-25e68cc0-c64e-4df8-bd06-dec53fc53ad7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:53.726472 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-25e68cc0-c64e-4df8-bd06-dec53fc53ad7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:53.727759 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-25e68cc0-c64e-4df8-bd06-dec53fc53ad7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:53.727759 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-25e68cc0-c64e-4df8-bd06-dec53fc53ad7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:53.727759 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-25e68cc0-c64e-4df8-bd06-dec53fc53ad7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:53.727759 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-25e68cc0-c64e-4df8-bd06-dec53fc53ad7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:53.911789 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-25e68cc0-c64e-4df8-bd06-dec53fc53ad7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:53.932736 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-25e68cc0-c64e-4df8-bd06-dec53fc53ad7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:53.936529 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-25e68cc0-c64e-4df8-bd06-dec53fc53ad7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:53.937973 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-25e68cc0-c64e-4df8-bd06-dec53fc53ad7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1333 microversion: 2.20 time: 0.244012 Sep 09 12:56:53.939409 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 25/46] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:56:53 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1333 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:56:53.975699 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-463a288d-b239-4426-b9c0-061bd744e881 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:53.978570 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-463a288d-b239-4426-b9c0-061bd744e881 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:53.985036 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-463a288d-b239-4426-b9c0-061bd744e881 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:53.986034 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-463a288d-b239-4426-b9c0-061bd744e881 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:53.986762 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-463a288d-b239-4426-b9c0-061bd744e881 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:53.988202 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-463a288d-b239-4426-b9c0-061bd744e881 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:53.988951 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-463a288d-b239-4426-b9c0-061bd744e881 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:53.989713 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-463a288d-b239-4426-b9c0-061bd744e881 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:54.134623 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-463a288d-b239-4426-b9c0-061bd744e881 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:54.156611 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-463a288d-b239-4426-b9c0-061bd744e881 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1301 microversion: 2.1 time: 0.185502 Sep 09 12:56:54.160157 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 22/47] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:53 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1301 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:54.242073 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-f19441ea-8ef1-4fee-9971-4b536795179d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:54.243132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-f19441ea-8ef1-4fee-9971-4b536795179d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:54.256789 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f19441ea-8ef1-4fee-9971-4b536795179d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:54.260874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f19441ea-8ef1-4fee-9971-4b536795179d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:54.265650 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f19441ea-8ef1-4fee-9971-4b536795179d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:54.265650 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f19441ea-8ef1-4fee-9971-4b536795179d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:54.278193 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f19441ea-8ef1-4fee-9971-4b536795179d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:54.279145 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f19441ea-8ef1-4fee-9971-4b536795179d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:54.801247 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-f19441ea-8ef1-4fee-9971-4b536795179d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:54.861614 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-f19441ea-8ef1-4fee-9971-4b536795179d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1315 microversion: 2.1 time: 0.601752 Sep 09 12:56:54.862832 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 26/48] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:54 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:54.976286 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-bf53c71e-a364-4805-8f47-91fae90f5321 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:54.978023 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-bf53c71e-a364-4805-8f47-91fae90f5321 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:55.002225 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bf53c71e-a364-4805-8f47-91fae90f5321 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:55.003122 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bf53c71e-a364-4805-8f47-91fae90f5321 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:55.003752 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bf53c71e-a364-4805-8f47-91fae90f5321 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:55.004831 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bf53c71e-a364-4805-8f47-91fae90f5321 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:55.005601 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bf53c71e-a364-4805-8f47-91fae90f5321 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:55.006170 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bf53c71e-a364-4805-8f47-91fae90f5321 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:55.157817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-bf53c71e-a364-4805-8f47-91fae90f5321 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:55.170914 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-bf53c71e-a364-4805-8f47-91fae90f5321 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:55.172904 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-bf53c71e-a364-4805-8f47-91fae90f5321 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:55.175690 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-bf53c71e-a364-4805-8f47-91fae90f5321 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1333 microversion: 2.20 time: 0.204966 Sep 09 12:56:55.195260 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ba6a49b4-6bd4-4b8c-8161-ecf1d2751f34 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:55.195260 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-ba6a49b4-6bd4-4b8c-8161-ecf1d2751f34 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:55.205561 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 23/49] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:56:54 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1333 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:56:55.217634 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ba6a49b4-6bd4-4b8c-8161-ecf1d2751f34 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:55.220271 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ba6a49b4-6bd4-4b8c-8161-ecf1d2751f34 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:55.224294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ba6a49b4-6bd4-4b8c-8161-ecf1d2751f34 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:55.226185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ba6a49b4-6bd4-4b8c-8161-ecf1d2751f34 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:55.228517 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ba6a49b4-6bd4-4b8c-8161-ecf1d2751f34 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:55.230543 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ba6a49b4-6bd4-4b8c-8161-ecf1d2751f34 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:55.395603 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ba6a49b4-6bd4-4b8c-8161-ecf1d2751f34 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:55.404961 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-ba6a49b4-6bd4-4b8c-8161-ecf1d2751f34 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1301 microversion: 2.1 time: 0.224058 Sep 09 12:56:55.410527 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 27/50] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:55 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1301 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:55.892103 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-c0a3b255-fd11-40bf-a0e4-685345f7b860 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:55.892994 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-c0a3b255-fd11-40bf-a0e4-685345f7b860 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:55.903930 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c0a3b255-fd11-40bf-a0e4-685345f7b860 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:55.910557 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c0a3b255-fd11-40bf-a0e4-685345f7b860 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:55.913874 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c0a3b255-fd11-40bf-a0e4-685345f7b860 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:55.916163 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c0a3b255-fd11-40bf-a0e4-685345f7b860 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:55.916886 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c0a3b255-fd11-40bf-a0e4-685345f7b860 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:55.917300 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c0a3b255-fd11-40bf-a0e4-685345f7b860 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:56.149693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-c0a3b255-fd11-40bf-a0e4-685345f7b860 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:56.159737 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-c0a3b255-fd11-40bf-a0e4-685345f7b860 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1315 microversion: 2.1 time: 0.276561 Sep 09 12:56:56.180167 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 24/51] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:55 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:56.213844 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-2ac25b21-68b5-4433-a503-1f4638f4e47c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:56.215340 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-2ac25b21-68b5-4433-a503-1f4638f4e47c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:56.231201 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=2 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:56:56.233280 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2ac25b21-68b5-4433-a503-1f4638f4e47c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:56.233978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2ac25b21-68b5-4433-a503-1f4638f4e47c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:56.234668 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2ac25b21-68b5-4433-a503-1f4638f4e47c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:56.235646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2ac25b21-68b5-4433-a503-1f4638f4e47c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:56.236294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2ac25b21-68b5-4433-a503-1f4638f4e47c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:56.237245 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2ac25b21-68b5-4433-a503-1f4638f4e47c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:56.347016 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-2ac25b21-68b5-4433-a503-1f4638f4e47c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:56.386192 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-2ac25b21-68b5-4433-a503-1f4638f4e47c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:56.390586 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-2ac25b21-68b5-4433-a503-1f4638f4e47c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:56.392679 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-2ac25b21-68b5-4433-a503-1f4638f4e47c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1333 microversion: 2.20 time: 0.184211 Sep 09 12:56:56.395041 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 28/52] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:56:56 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1333 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:56:56.434139 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7f8d9299-ba97-4ba6-b68f-9cad2909734d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:56.434804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7f8d9299-ba97-4ba6-b68f-9cad2909734d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:56.448943 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7f8d9299-ba97-4ba6-b68f-9cad2909734d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:56.453435 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7f8d9299-ba97-4ba6-b68f-9cad2909734d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:56.453435 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7f8d9299-ba97-4ba6-b68f-9cad2909734d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:56.453435 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7f8d9299-ba97-4ba6-b68f-9cad2909734d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:56.453435 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7f8d9299-ba97-4ba6-b68f-9cad2909734d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:56.455473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7f8d9299-ba97-4ba6-b68f-9cad2909734d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:56.582983 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7f8d9299-ba97-4ba6-b68f-9cad2909734d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:56.602912 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7f8d9299-ba97-4ba6-b68f-9cad2909734d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1301 microversion: 2.1 time: 0.174952 Sep 09 12:56:56.603612 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 29/53] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:56 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1301 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:56:56.616755 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-a4fb9b29-a002-4fec-8c47-a8db0990cbd3 req-06254bdc-c6a2-46eb-88da-91e4581eac05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3f10f11-bf68-4455-85ee-f551c7742ee9", "tag": "d60b84b9-cc3d-43da-a44b-2752f25ecee4"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:56:56.633512 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-a4fb9b29-a002-4fec-8c47-a8db0990cbd3 req-06254bdc-c6a2-46eb-88da-91e4581eac05 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:56.633512 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-a4fb9b29-a002-4fec-8c47-a8db0990cbd3 req-06254bdc-c6a2-46eb-88da-91e4581eac05 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:56.633512 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-a4fb9b29-a002-4fec-8c47-a8db0990cbd3 req-06254bdc-c6a2-46eb-88da-91e4581eac05 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:56.708431 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-a4fb9b29-a002-4fec-8c47-a8db0990cbd3 req-06254bdc-c6a2-46eb-88da-91e4581eac05 service nova] Creating event network-changed:d60b84b9-cc3d-43da-a44b-2752f25ecee4 for instance a3f10f11-bf68-4455-85ee-f551c7742ee9 on hv-cinder-81322 Sep 09 12:56:56.708968 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-a4fb9b29-a002-4fec-8c47-a8db0990cbd3 req-06254bdc-c6a2-46eb-88da-91e4581eac05 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 12:56:56.709363 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-a4fb9b29-a002-4fec-8c47-a8db0990cbd3 req-06254bdc-c6a2-46eb-88da-91e4581eac05 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 12:56:56.710510 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1e5d1cec-2e6e-48a4-a5d5-3fa63693c918 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:56.710981 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1e5d1cec-2e6e-48a4-a5d5-3fa63693c918 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:56.711418 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1e5d1cec-2e6e-48a4-a5d5-3fa63693c918 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:56.712134 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1e5d1cec-2e6e-48a4-a5d5-3fa63693c918 None None] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:56.712588 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1e5d1cec-2e6e-48a4-a5d5-3fa63693c918 None None] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:56.713011 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1e5d1cec-2e6e-48a4-a5d5-3fa63693c918 None None] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:56.725580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.compute.rpcapi [None req-1e5d1cec-2e6e-48a4-a5d5-3fa63693c918 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 12:56:56.726556 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1e5d1cec-2e6e-48a4-a5d5-3fa63693c918 None None] Releasing lock "compute-rpcapi-router" {{(pid=127771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 12:56:56.754103 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-1e5d1cec-2e6e-48a4-a5d5-3fa63693c918 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.421205 Sep 09 12:56:56.755127 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 25/54] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:56:57.185876 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7a113875-f45b-42dc-9c79-5a1581eb43c2 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:57.186689 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7a113875-f45b-42dc-9c79-5a1581eb43c2 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:57.193843 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a113875-f45b-42dc-9c79-5a1581eb43c2 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:57.194329 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a113875-f45b-42dc-9c79-5a1581eb43c2 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:57.194868 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a113875-f45b-42dc-9c79-5a1581eb43c2 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:57.195558 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a113875-f45b-42dc-9c79-5a1581eb43c2 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:57.196013 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a113875-f45b-42dc-9c79-5a1581eb43c2 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:57.196475 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a113875-f45b-42dc-9c79-5a1581eb43c2 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:57.397512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7a113875-f45b-42dc-9c79-5a1581eb43c2 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:57.409089 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7a113875-f45b-42dc-9c79-5a1581eb43c2 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1315 microversion: 2.1 time: 0.227431 Sep 09 12:56:57.419522 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 30/55] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:57 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:57.420986 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8537c54b-8c1f-4610-9618-2e1b88b0d916 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:57.422256 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-8537c54b-8c1f-4610-9618-2e1b88b0d916 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:57.433038 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8537c54b-8c1f-4610-9618-2e1b88b0d916 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:57.433538 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8537c54b-8c1f-4610-9618-2e1b88b0d916 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:57.433984 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8537c54b-8c1f-4610-9618-2e1b88b0d916 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:57.434733 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8537c54b-8c1f-4610-9618-2e1b88b0d916 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:57.435473 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8537c54b-8c1f-4610-9618-2e1b88b0d916 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:57.436052 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8537c54b-8c1f-4610-9618-2e1b88b0d916 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:57.570770 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-8537c54b-8c1f-4610-9618-2e1b88b0d916 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:57.617340 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-8537c54b-8c1f-4610-9618-2e1b88b0d916 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:57.618965 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-8537c54b-8c1f-4610-9618-2e1b88b0d916 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:57.620227 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-8537c54b-8c1f-4610-9618-2e1b88b0d916 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1333 microversion: 2.20 time: 0.203597 Sep 09 12:56:57.626005 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 26/56] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:56:57 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1333 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:56:57.636268 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-f3ae8ef4-bdb4-486a-af84-d5445a18804e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:57.636268 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-f3ae8ef4-bdb4-486a-af84-d5445a18804e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:57.641028 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f3ae8ef4-bdb4-486a-af84-d5445a18804e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:57.642523 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f3ae8ef4-bdb4-486a-af84-d5445a18804e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:57.645586 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f3ae8ef4-bdb4-486a-af84-d5445a18804e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:57.646669 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f3ae8ef4-bdb4-486a-af84-d5445a18804e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:57.648289 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f3ae8ef4-bdb4-486a-af84-d5445a18804e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:57.650680 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f3ae8ef4-bdb4-486a-af84-d5445a18804e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:57.776670 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-f3ae8ef4-bdb4-486a-af84-d5445a18804e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:57.785083 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-f3ae8ef4-bdb4-486a-af84-d5445a18804e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1301 microversion: 2.1 time: 0.162869 Sep 09 12:56:57.787286 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 31/57] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:57 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1301 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:58.434421 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-4dec3652-2bb0-402e-be2c-40989dcfab62 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:58.436217 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-4dec3652-2bb0-402e-be2c-40989dcfab62 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:58.443176 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4dec3652-2bb0-402e-be2c-40989dcfab62 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:58.443662 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4dec3652-2bb0-402e-be2c-40989dcfab62 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:58.444245 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4dec3652-2bb0-402e-be2c-40989dcfab62 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:58.445175 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4dec3652-2bb0-402e-be2c-40989dcfab62 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:58.445809 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4dec3652-2bb0-402e-be2c-40989dcfab62 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:58.446419 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4dec3652-2bb0-402e-be2c-40989dcfab62 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:58.598708 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-4dec3652-2bb0-402e-be2c-40989dcfab62 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:58.608756 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-4dec3652-2bb0-402e-be2c-40989dcfab62 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1315 microversion: 2.1 time: 0.179197 Sep 09 12:56:58.619903 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 27/58] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:58 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:56:58.649305 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-6a93c019-b2b6-4f6a-a64b-f2591ab857d2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:58.649952 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-6a93c019-b2b6-4f6a-a64b-f2591ab857d2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:58.654533 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=22 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:56:58.658509 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6a93c019-b2b6-4f6a-a64b-f2591ab857d2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:58.659231 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6a93c019-b2b6-4f6a-a64b-f2591ab857d2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:58.659923 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6a93c019-b2b6-4f6a-a64b-f2591ab857d2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:58.661563 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6a93c019-b2b6-4f6a-a64b-f2591ab857d2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:58.662635 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6a93c019-b2b6-4f6a-a64b-f2591ab857d2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:58.663361 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6a93c019-b2b6-4f6a-a64b-f2591ab857d2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:58.760649 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-6a93c019-b2b6-4f6a-a64b-f2591ab857d2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:58.770387 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-6a93c019-b2b6-4f6a-a64b-f2591ab857d2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:58.774951 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-6a93c019-b2b6-4f6a-a64b-f2591ab857d2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:58.774951 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-6a93c019-b2b6-4f6a-a64b-f2591ab857d2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1333 microversion: 2.20 time: 0.128424 Sep 09 12:56:58.775403 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 32/59] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:56:58 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1333 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:56:58.822140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-b06985bf-60c8-476d-b744-808bf52319f1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:58.823730 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-b06985bf-60c8-476d-b744-808bf52319f1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:58.834980 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b06985bf-60c8-476d-b744-808bf52319f1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:58.834980 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b06985bf-60c8-476d-b744-808bf52319f1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:58.834980 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b06985bf-60c8-476d-b744-808bf52319f1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:58.834980 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b06985bf-60c8-476d-b744-808bf52319f1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:58.835277 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b06985bf-60c8-476d-b744-808bf52319f1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:58.835277 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b06985bf-60c8-476d-b744-808bf52319f1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:58.907531 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-b06985bf-60c8-476d-b744-808bf52319f1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:58.918220 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-b06985bf-60c8-476d-b744-808bf52319f1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1301 microversion: 2.1 time: 0.108608 Sep 09 12:56:58.918822 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 28/60] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:58 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1301 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:59.633706 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e11921b5-387c-47d4-b224-011f0b1994d7 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:59.634325 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e11921b5-387c-47d4-b224-011f0b1994d7 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:59.646309 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e11921b5-387c-47d4-b224-011f0b1994d7 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:59.646831 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e11921b5-387c-47d4-b224-011f0b1994d7 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:59.649243 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e11921b5-387c-47d4-b224-011f0b1994d7 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:59.649989 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e11921b5-387c-47d4-b224-011f0b1994d7 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:59.656102 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e11921b5-387c-47d4-b224-011f0b1994d7 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:59.656835 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e11921b5-387c-47d4-b224-011f0b1994d7 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:59.804395 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0cf5c9fe-a456-4741-8438-e3c6d788c1e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:59.805009 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-0cf5c9fe-a456-4741-8438-e3c6d788c1e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:56:59.807201 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=20 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:56:59.812968 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0cf5c9fe-a456-4741-8438-e3c6d788c1e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:59.813667 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0cf5c9fe-a456-4741-8438-e3c6d788c1e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:59.815431 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0cf5c9fe-a456-4741-8438-e3c6d788c1e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:59.816288 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0cf5c9fe-a456-4741-8438-e3c6d788c1e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:56:59.817071 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0cf5c9fe-a456-4741-8438-e3c6d788c1e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:56:59.817637 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0cf5c9fe-a456-4741-8438-e3c6d788c1e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:56:59.970735 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e11921b5-387c-47d4-b224-011f0b1994d7 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:56:59.980238 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e11921b5-387c-47d4-b224-011f0b1994d7 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1315 microversion: 2.1 time: 0.350605 Sep 09 12:56:59.986250 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 33/61] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:59 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:56:59.991419 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-0f8d9524-3c2a-4fd6-bdbc-8d7212645eb9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:56:59.993758 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-0f8d9524-3c2a-4fd6-bdbc-8d7212645eb9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:00.011984 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0f8d9524-3c2a-4fd6-bdbc-8d7212645eb9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:00.012709 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0f8d9524-3c2a-4fd6-bdbc-8d7212645eb9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:00.013298 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0f8d9524-3c2a-4fd6-bdbc-8d7212645eb9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:00.014145 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0f8d9524-3c2a-4fd6-bdbc-8d7212645eb9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:00.014911 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0f8d9524-3c2a-4fd6-bdbc-8d7212645eb9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:00.015474 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0f8d9524-3c2a-4fd6-bdbc-8d7212645eb9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:00.023664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=100 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:57:00.122990 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-0cf5c9fe-a456-4741-8438-e3c6d788c1e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:00.139460 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-0cf5c9fe-a456-4741-8438-e3c6d788c1e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:00.144407 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-0cf5c9fe-a456-4741-8438-e3c6d788c1e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:00.152702 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-0f8d9524-3c2a-4fd6-bdbc-8d7212645eb9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:00.161290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0cf5c9fe-a456-4741-8438-e3c6d788c1e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1333 microversion: 2.20 time: 0.346463 Sep 09 12:57:00.162434 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-0f8d9524-3c2a-4fd6-bdbc-8d7212645eb9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1301 microversion: 2.1 time: 0.174695 Sep 09 12:57:00.175184 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 29/62] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:56:59 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1333 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:57:00.175540 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 34/63] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:56:59 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1301 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:01.012000 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-9c8eddbb-082a-448f-bd80-89a6efefddcd tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:01.015854 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-9c8eddbb-082a-448f-bd80-89a6efefddcd tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:01.035719 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9c8eddbb-082a-448f-bd80-89a6efefddcd tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:01.036686 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9c8eddbb-082a-448f-bd80-89a6efefddcd tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:01.037901 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9c8eddbb-082a-448f-bd80-89a6efefddcd tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:01.041690 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9c8eddbb-082a-448f-bd80-89a6efefddcd tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:01.042310 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9c8eddbb-082a-448f-bd80-89a6efefddcd tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:01.042798 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9c8eddbb-082a-448f-bd80-89a6efefddcd tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:01.196907 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-1427a63e-e950-4f06-b8a8-c08307de344d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:01.213688 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-1427a63e-e950-4f06-b8a8-c08307de344d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:01.213688 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1427a63e-e950-4f06-b8a8-c08307de344d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:01.213688 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1427a63e-e950-4f06-b8a8-c08307de344d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:01.214075 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1427a63e-e950-4f06-b8a8-c08307de344d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:01.215965 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1427a63e-e950-4f06-b8a8-c08307de344d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:01.216491 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1427a63e-e950-4f06-b8a8-c08307de344d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:01.216950 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1427a63e-e950-4f06-b8a8-c08307de344d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:01.319001 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-9c8eddbb-082a-448f-bd80-89a6efefddcd tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:01.326901 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-9c8eddbb-082a-448f-bd80-89a6efefddcd tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1315 microversion: 2.1 time: 0.319140 Sep 09 12:57:01.327883 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 30/64] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:01 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:01.334348 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-04f2b58c-02ae-438f-ac88-a0e15a5cf042 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:01.335391 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-04f2b58c-02ae-438f-ac88-a0e15a5cf042 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:01.339640 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-1427a63e-e950-4f06-b8a8-c08307de344d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:01.342401 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-04f2b58c-02ae-438f-ac88-a0e15a5cf042 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:01.343074 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-04f2b58c-02ae-438f-ac88-a0e15a5cf042 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:01.344959 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-04f2b58c-02ae-438f-ac88-a0e15a5cf042 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:01.345845 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-04f2b58c-02ae-438f-ac88-a0e15a5cf042 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:01.346684 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-04f2b58c-02ae-438f-ac88-a0e15a5cf042 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:01.347376 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-04f2b58c-02ae-438f-ac88-a0e15a5cf042 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:01.350367 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-1427a63e-e950-4f06-b8a8-c08307de344d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:01.352081 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-1427a63e-e950-4f06-b8a8-c08307de344d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:01.353356 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-1427a63e-e950-4f06-b8a8-c08307de344d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1339 microversion: 2.20 time: 0.164100 Sep 09 12:57:01.370511 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 35/65] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:57:01 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1339 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:57:01.450060 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-04f2b58c-02ae-438f-ac88-a0e15a5cf042 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:01.466805 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-04f2b58c-02ae-438f-ac88-a0e15a5cf042 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1299 microversion: 2.1 time: 0.137376 Sep 09 12:57:01.467194 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 31/66] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:01 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1299 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:02.353982 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-d5e3b82e-910c-4154-94ae-df1310993854 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:02.356473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-d5e3b82e-910c-4154-94ae-df1310993854 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:02.372732 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d5e3b82e-910c-4154-94ae-df1310993854 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:02.373233 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d5e3b82e-910c-4154-94ae-df1310993854 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:02.373668 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d5e3b82e-910c-4154-94ae-df1310993854 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:02.374440 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d5e3b82e-910c-4154-94ae-df1310993854 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:02.374954 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d5e3b82e-910c-4154-94ae-df1310993854 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:02.375377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d5e3b82e-910c-4154-94ae-df1310993854 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:02.383677 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-081cb118-28b3-45c4-80eb-7ad800a3cd38 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:02.384268 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-081cb118-28b3-45c4-80eb-7ad800a3cd38 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:02.391759 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-081cb118-28b3-45c4-80eb-7ad800a3cd38 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:02.394477 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-081cb118-28b3-45c4-80eb-7ad800a3cd38 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:02.396409 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-081cb118-28b3-45c4-80eb-7ad800a3cd38 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:02.398778 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-081cb118-28b3-45c4-80eb-7ad800a3cd38 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:02.399251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-081cb118-28b3-45c4-80eb-7ad800a3cd38 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:02.403039 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-081cb118-28b3-45c4-80eb-7ad800a3cd38 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:02.416881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=100 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:57:02.620597 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-081cb118-28b3-45c4-80eb-7ad800a3cd38 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:02.637023 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-d5e3b82e-910c-4154-94ae-df1310993854 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:02.648386 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-d5e3b82e-910c-4154-94ae-df1310993854 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1315 microversion: 2.1 time: 0.300720 Sep 09 12:57:02.651898 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-081cb118-28b3-45c4-80eb-7ad800a3cd38 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:02.652985 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 36/67] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:02 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:02.656921 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-081cb118-28b3-45c4-80eb-7ad800a3cd38 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:02.663138 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-081cb118-28b3-45c4-80eb-7ad800a3cd38 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1407 microversion: 2.20 time: 0.278383 Sep 09 12:57:02.663138 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 32/68] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:57:02 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:57:02.663698 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-eaaf5b68-814f-4300-b913-3b71cd2cded7 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:02.664533 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-eaaf5b68-814f-4300-b913-3b71cd2cded7 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:02.676304 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-eaaf5b68-814f-4300-b913-3b71cd2cded7 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:02.677089 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-eaaf5b68-814f-4300-b913-3b71cd2cded7 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:02.677788 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-eaaf5b68-814f-4300-b913-3b71cd2cded7 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:02.678691 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-eaaf5b68-814f-4300-b913-3b71cd2cded7 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:02.679299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-eaaf5b68-814f-4300-b913-3b71cd2cded7 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:02.679877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-eaaf5b68-814f-4300-b913-3b71cd2cded7 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:03.146157 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-eaaf5b68-814f-4300-b913-3b71cd2cded7 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:03.160453 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-eaaf5b68-814f-4300-b913-3b71cd2cded7 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1367 microversion: 2.1 time: 0.505807 Sep 09 12:57:03.162235 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 37/69] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:02 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1367 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:03.692058 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a032c1b9-adfe-4713-9bd2-62ca7efb52d0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:03.692058 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-a032c1b9-adfe-4713-9bd2-62ca7efb52d0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:03.694724 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c5ba2931-9389-4908-b79d-3ec7a917071a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:03.695362 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-c5ba2931-9389-4908-b79d-3ec7a917071a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:03.700393 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:57:03.706061 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c5ba2931-9389-4908-b79d-3ec7a917071a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:03.706590 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c5ba2931-9389-4908-b79d-3ec7a917071a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:03.707034 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c5ba2931-9389-4908-b79d-3ec7a917071a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:03.708891 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a032c1b9-adfe-4713-9bd2-62ca7efb52d0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:03.709594 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a032c1b9-adfe-4713-9bd2-62ca7efb52d0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:03.710190 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a032c1b9-adfe-4713-9bd2-62ca7efb52d0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:03.711290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a032c1b9-adfe-4713-9bd2-62ca7efb52d0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:03.712069 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a032c1b9-adfe-4713-9bd2-62ca7efb52d0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:03.712644 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a032c1b9-adfe-4713-9bd2-62ca7efb52d0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:03.713596 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c5ba2931-9389-4908-b79d-3ec7a917071a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:03.717188 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c5ba2931-9389-4908-b79d-3ec7a917071a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:03.722611 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c5ba2931-9389-4908-b79d-3ec7a917071a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:03.901658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-a032c1b9-adfe-4713-9bd2-62ca7efb52d0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:03.915282 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-a032c1b9-adfe-4713-9bd2-62ca7efb52d0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1315 microversion: 2.1 time: 0.231075 Sep 09 12:57:03.915282 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 33/70] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:03 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:04.185643 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-1a334c7c-b228-4b7e-9799-59de3b80af8b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:04.186537 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-1a334c7c-b228-4b7e-9799-59de3b80af8b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:04.208951 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1a334c7c-b228-4b7e-9799-59de3b80af8b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:04.210669 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1a334c7c-b228-4b7e-9799-59de3b80af8b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:04.211442 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1a334c7c-b228-4b7e-9799-59de3b80af8b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:04.213118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1a334c7c-b228-4b7e-9799-59de3b80af8b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:04.213811 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1a334c7c-b228-4b7e-9799-59de3b80af8b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:04.215347 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1a334c7c-b228-4b7e-9799-59de3b80af8b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:04.384484 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c5ba2931-9389-4908-b79d-3ec7a917071a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:04.400235 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c5ba2931-9389-4908-b79d-3ec7a917071a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:04.404273 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c5ba2931-9389-4908-b79d-3ec7a917071a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:04.406343 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-c5ba2931-9389-4908-b79d-3ec7a917071a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1407 microversion: 2.20 time: 0.718866 Sep 09 12:57:04.407431 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 38/71] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:57:03 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1407 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:57:04.495041 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-1a334c7c-b228-4b7e-9799-59de3b80af8b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:04.503483 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-1a334c7c-b228-4b7e-9799-59de3b80af8b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1367 microversion: 2.1 time: 0.322755 Sep 09 12:57:04.504152 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 34/72] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:04 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1367 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:57:04.790270 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-db0d6dec-10f6-4382-a08c-db07f52e4039 req-be8e2cfb-0a2f-4102-8095-a01633f1abd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f59545d-0b40-4f82-94e2-789c728a6bed", "tag": "7dc91708-0aac-4dd5-b9ff-cd3faa6becbe"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:57:04.809947 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-db0d6dec-10f6-4382-a08c-db07f52e4039 req-be8e2cfb-0a2f-4102-8095-a01633f1abd3 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:04.811143 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-db0d6dec-10f6-4382-a08c-db07f52e4039 req-be8e2cfb-0a2f-4102-8095-a01633f1abd3 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:04.811143 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-db0d6dec-10f6-4382-a08c-db07f52e4039 req-be8e2cfb-0a2f-4102-8095-a01633f1abd3 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:04.843469 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-db0d6dec-10f6-4382-a08c-db07f52e4039 req-be8e2cfb-0a2f-4102-8095-a01633f1abd3 service nova] Creating event network-changed:7dc91708-0aac-4dd5-b9ff-cd3faa6becbe for instance 7f59545d-0b40-4f82-94e2-789c728a6bed on hv-cinder-81322 Sep 09 12:57:04.844007 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-db0d6dec-10f6-4382-a08c-db07f52e4039 req-be8e2cfb-0a2f-4102-8095-a01633f1abd3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 12:57:04.844406 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-db0d6dec-10f6-4382-a08c-db07f52e4039 req-be8e2cfb-0a2f-4102-8095-a01633f1abd3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 12:57:04.845500 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a7a1f537-cada-4f8d-8c0f-7a2d7f28eaf6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:04.846107 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a7a1f537-cada-4f8d-8c0f-7a2d7f28eaf6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:04.846719 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a7a1f537-cada-4f8d-8c0f-7a2d7f28eaf6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:04.847467 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a7a1f537-cada-4f8d-8c0f-7a2d7f28eaf6 None None] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:04.847887 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a7a1f537-cada-4f8d-8c0f-7a2d7f28eaf6 None None] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:04.848316 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a7a1f537-cada-4f8d-8c0f-7a2d7f28eaf6 None None] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:04.868437 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.compute.rpcapi [None req-a7a1f537-cada-4f8d-8c0f-7a2d7f28eaf6 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 12:57:04.868437 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a7a1f537-cada-4f8d-8c0f-7a2d7f28eaf6 None None] Releasing lock "compute-rpcapi-router" {{(pid=127772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 12:57:04.896400 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a7a1f537-cada-4f8d-8c0f-7a2d7f28eaf6 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119591 Sep 09 12:57:04.897289 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 39/73] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:57:04.937095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-3dfa8de9-760a-4235-a5c2-6843552500c0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:04.937785 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-3dfa8de9-760a-4235-a5c2-6843552500c0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:04.944502 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3dfa8de9-760a-4235-a5c2-6843552500c0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:04.945043 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3dfa8de9-760a-4235-a5c2-6843552500c0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:04.946637 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3dfa8de9-760a-4235-a5c2-6843552500c0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:04.951271 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3dfa8de9-760a-4235-a5c2-6843552500c0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:04.955964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3dfa8de9-760a-4235-a5c2-6843552500c0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:04.955964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3dfa8de9-760a-4235-a5c2-6843552500c0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:05.136142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-3dfa8de9-760a-4235-a5c2-6843552500c0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:05.145880 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-3dfa8de9-760a-4235-a5c2-6843552500c0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1315 microversion: 2.1 time: 0.213300 Sep 09 12:57:05.147224 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 35/74] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:04 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:05.433534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-78310d30-86a3-47e0-bae7-1e29cddc0558 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:05.434235 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-78310d30-86a3-47e0-bae7-1e29cddc0558 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:05.441276 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-78310d30-86a3-47e0-bae7-1e29cddc0558 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:05.445991 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-78310d30-86a3-47e0-bae7-1e29cddc0558 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:05.445991 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-78310d30-86a3-47e0-bae7-1e29cddc0558 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:05.445991 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-78310d30-86a3-47e0-bae7-1e29cddc0558 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:05.445991 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-78310d30-86a3-47e0-bae7-1e29cddc0558 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:05.446469 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-78310d30-86a3-47e0-bae7-1e29cddc0558 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:05.529578 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d976aa49-3c91-44ef-b0ab-09b437ea1994 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:05.532100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-d976aa49-3c91-44ef-b0ab-09b437ea1994 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:05.538173 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d976aa49-3c91-44ef-b0ab-09b437ea1994 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:05.538826 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d976aa49-3c91-44ef-b0ab-09b437ea1994 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:05.539340 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d976aa49-3c91-44ef-b0ab-09b437ea1994 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:05.540275 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d976aa49-3c91-44ef-b0ab-09b437ea1994 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:05.541294 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d976aa49-3c91-44ef-b0ab-09b437ea1994 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:05.541795 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d976aa49-3c91-44ef-b0ab-09b437ea1994 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:05.810540 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-d976aa49-3c91-44ef-b0ab-09b437ea1994 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:05.820373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d976aa49-3c91-44ef-b0ab-09b437ea1994 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1367 microversion: 2.1 time: 0.296073 Sep 09 12:57:05.822981 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 36/75] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:05 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:57:05.904679 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-78310d30-86a3-47e0-bae7-1e29cddc0558 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:05.921343 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-78310d30-86a3-47e0-bae7-1e29cddc0558 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:05.923718 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-78310d30-86a3-47e0-bae7-1e29cddc0558 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:05.925151 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-78310d30-86a3-47e0-bae7-1e29cddc0558 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1407 microversion: 2.20 time: 0.495743 Sep 09 12:57:05.925724 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 40/76] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:57:05 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:57:06.169682 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-94690c46-5098-4de1-9db7-dc8d5b845b11 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:06.170290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-94690c46-5098-4de1-9db7-dc8d5b845b11 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:06.176943 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-94690c46-5098-4de1-9db7-dc8d5b845b11 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:06.178741 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-94690c46-5098-4de1-9db7-dc8d5b845b11 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:06.178741 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-94690c46-5098-4de1-9db7-dc8d5b845b11 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:06.178741 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-94690c46-5098-4de1-9db7-dc8d5b845b11 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:06.179076 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-94690c46-5098-4de1-9db7-dc8d5b845b11 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:06.179357 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-94690c46-5098-4de1-9db7-dc8d5b845b11 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:06.424812 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-94690c46-5098-4de1-9db7-dc8d5b845b11 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:06.432860 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-94690c46-5098-4de1-9db7-dc8d5b845b11 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1315 microversion: 2.1 time: 0.266935 Sep 09 12:57:06.433609 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 37/77] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:06 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:06.854755 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-41739f47-aa00-4358-b864-977dfb629b21 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:06.855666 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-41739f47-aa00-4358-b864-977dfb629b21 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:06.865327 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-41739f47-aa00-4358-b864-977dfb629b21 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:06.866308 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-41739f47-aa00-4358-b864-977dfb629b21 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:06.866812 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-41739f47-aa00-4358-b864-977dfb629b21 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:06.867571 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-41739f47-aa00-4358-b864-977dfb629b21 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:06.868112 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-41739f47-aa00-4358-b864-977dfb629b21 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:06.868547 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-41739f47-aa00-4358-b864-977dfb629b21 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:06.922143 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-7287eea5-29a2-48f8-8144-7aa3a2c9a85f req-abed7c99-5592-47eb-8ffc-283a8c651894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78dad9a3-ac85-4014-829c-986cca18c8b1", "tag": "244f1be5-c384-494f-b53f-53fb6f1b2689"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:57:06.927938 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=6 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:57:06.928620 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:57:06.944009 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-7287eea5-29a2-48f8-8144-7aa3a2c9a85f req-abed7c99-5592-47eb-8ffc-283a8c651894 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:06.944454 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-7287eea5-29a2-48f8-8144-7aa3a2c9a85f req-abed7c99-5592-47eb-8ffc-283a8c651894 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:06.945072 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-7287eea5-29a2-48f8-8144-7aa3a2c9a85f req-abed7c99-5592-47eb-8ffc-283a8c651894 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:06.960124 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-7287eea5-29a2-48f8-8144-7aa3a2c9a85f req-abed7c99-5592-47eb-8ffc-283a8c651894 service nova] Creating event network-changed:244f1be5-c384-494f-b53f-53fb6f1b2689 for instance 78dad9a3-ac85-4014-829c-986cca18c8b1 on hv-cinder-81322 Sep 09 12:57:06.965703 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-7287eea5-29a2-48f8-8144-7aa3a2c9a85f req-abed7c99-5592-47eb-8ffc-283a8c651894 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047393 Sep 09 12:57:06.966530 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 38/78] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:57:06.973531 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-b3a80d7c-0196-4153-a4bd-4cdd9e71eb46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:06.974730 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-b3a80d7c-0196-4153-a4bd-4cdd9e71eb46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:06.982519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b3a80d7c-0196-4153-a4bd-4cdd9e71eb46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:06.983268 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b3a80d7c-0196-4153-a4bd-4cdd9e71eb46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:06.983913 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b3a80d7c-0196-4153-a4bd-4cdd9e71eb46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:06.984997 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b3a80d7c-0196-4153-a4bd-4cdd9e71eb46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:06.985617 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b3a80d7c-0196-4153-a4bd-4cdd9e71eb46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:06.986207 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b3a80d7c-0196-4153-a4bd-4cdd9e71eb46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:07.110917 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-41739f47-aa00-4358-b864-977dfb629b21 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:07.124242 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-41739f47-aa00-4358-b864-977dfb629b21 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1367 microversion: 2.1 time: 0.273154 Sep 09 12:57:07.125542 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 41/79] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:06 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:07.143551 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-b3a80d7c-0196-4153-a4bd-4cdd9e71eb46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:07.152569 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-b3a80d7c-0196-4153-a4bd-4cdd9e71eb46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:07.154309 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-b3a80d7c-0196-4153-a4bd-4cdd9e71eb46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:07.156673 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-b3a80d7c-0196-4153-a4bd-4cdd9e71eb46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1407 microversion: 2.20 time: 0.187741 Sep 09 12:57:07.161075 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 39/80] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:57:06 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:57:07.456894 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-4d05c9ec-6fd4-4efa-9449-409a6199b231 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:07.457510 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-4d05c9ec-6fd4-4efa-9449-409a6199b231 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:07.463681 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d05c9ec-6fd4-4efa-9449-409a6199b231 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:07.464200 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d05c9ec-6fd4-4efa-9449-409a6199b231 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:07.464644 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d05c9ec-6fd4-4efa-9449-409a6199b231 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:07.465393 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d05c9ec-6fd4-4efa-9449-409a6199b231 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:07.465850 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d05c9ec-6fd4-4efa-9449-409a6199b231 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:07.466274 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d05c9ec-6fd4-4efa-9449-409a6199b231 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:07.601261 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-4d05c9ec-6fd4-4efa-9449-409a6199b231 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:07.618676 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-4d05c9ec-6fd4-4efa-9449-409a6199b231 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1315 microversion: 2.1 time: 0.157877 Sep 09 12:57:07.618676 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 42/81] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:07 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:08.150755 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-b099a273-cc4f-44e3-88fa-4e1d75f4f60d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:08.151877 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-b099a273-cc4f-44e3-88fa-4e1d75f4f60d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:08.166138 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b099a273-cc4f-44e3-88fa-4e1d75f4f60d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:08.166924 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b099a273-cc4f-44e3-88fa-4e1d75f4f60d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:08.167669 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b099a273-cc4f-44e3-88fa-4e1d75f4f60d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:08.168633 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b099a273-cc4f-44e3-88fa-4e1d75f4f60d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:08.169302 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b099a273-cc4f-44e3-88fa-4e1d75f4f60d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:08.169910 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b099a273-cc4f-44e3-88fa-4e1d75f4f60d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:08.186077 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c5452c2a-ae7c-4141-8ed9-775e1dae2a4d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:08.187802 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-c5452c2a-ae7c-4141-8ed9-775e1dae2a4d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:08.201252 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c5452c2a-ae7c-4141-8ed9-775e1dae2a4d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:08.206624 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c5452c2a-ae7c-4141-8ed9-775e1dae2a4d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:08.207722 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c5452c2a-ae7c-4141-8ed9-775e1dae2a4d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:08.208848 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c5452c2a-ae7c-4141-8ed9-775e1dae2a4d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:08.209614 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c5452c2a-ae7c-4141-8ed9-775e1dae2a4d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:08.218738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c5452c2a-ae7c-4141-8ed9-775e1dae2a4d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:08.382397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-b099a273-cc4f-44e3-88fa-4e1d75f4f60d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:08.396400 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c5452c2a-ae7c-4141-8ed9-775e1dae2a4d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:08.399016 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-b099a273-cc4f-44e3-88fa-4e1d75f4f60d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1367 microversion: 2.1 time: 0.252386 Sep 09 12:57:08.399988 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 40/82] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:08 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:08.405073 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c5452c2a-ae7c-4141-8ed9-775e1dae2a4d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:08.406557 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c5452c2a-ae7c-4141-8ed9-775e1dae2a4d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:08.414669 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-c5452c2a-ae7c-4141-8ed9-775e1dae2a4d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1407 microversion: 2.20 time: 0.232854 Sep 09 12:57:08.425842 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 43/83] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:57:08 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:57:08.635200 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-1ae7564c-389e-4664-a05f-89324fc747c1 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:08.636528 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-1ae7564c-389e-4664-a05f-89324fc747c1 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:08.646309 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1ae7564c-389e-4664-a05f-89324fc747c1 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:08.649570 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1ae7564c-389e-4664-a05f-89324fc747c1 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:08.650615 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1ae7564c-389e-4664-a05f-89324fc747c1 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:08.653604 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1ae7564c-389e-4664-a05f-89324fc747c1 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:08.653604 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1ae7564c-389e-4664-a05f-89324fc747c1 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:08.654883 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1ae7564c-389e-4664-a05f-89324fc747c1 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:09.003996 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-1ae7564c-389e-4664-a05f-89324fc747c1 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:09.012530 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-1ae7564c-389e-4664-a05f-89324fc747c1 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1315 microversion: 2.1 time: 0.382113 Sep 09 12:57:09.013366 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 41/84] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:08 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:09.068299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-001f0ede-a40e-4bce-9cba-d059dde9efd8 req-f0f61738-3248-4f2d-85e0-d5f4583ddfd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f10f11-bf68-4455-85ee-f551c7742ee9", "name": "network-vif-plugged", "status": "completed", "tag": "d60b84b9-cc3d-43da-a44b-2752f25ecee4"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:57:09.079147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-001f0ede-a40e-4bce-9cba-d059dde9efd8 req-f0f61738-3248-4f2d-85e0-d5f4583ddfd8 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:09.079620 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-001f0ede-a40e-4bce-9cba-d059dde9efd8 req-f0f61738-3248-4f2d-85e0-d5f4583ddfd8 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:09.080048 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-001f0ede-a40e-4bce-9cba-d059dde9efd8 req-f0f61738-3248-4f2d-85e0-d5f4583ddfd8 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:09.091167 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-001f0ede-a40e-4bce-9cba-d059dde9efd8 req-f0f61738-3248-4f2d-85e0-d5f4583ddfd8 service nova] Creating event network-vif-plugged:d60b84b9-cc3d-43da-a44b-2752f25ecee4 for instance a3f10f11-bf68-4455-85ee-f551c7742ee9 on hv-cinder-81322 Sep 09 12:57:09.096724 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-001f0ede-a40e-4bce-9cba-d059dde9efd8 req-f0f61738-3248-4f2d-85e0-d5f4583ddfd8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.340269 Sep 09 12:57:09.097330 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 44/85] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:57:09.423444 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-9c7252dd-e540-414b-913f-e87c7b8f7cc1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:09.424209 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-9c7252dd-e540-414b-913f-e87c7b8f7cc1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:09.430617 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9c7252dd-e540-414b-913f-e87c7b8f7cc1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:09.431100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9c7252dd-e540-414b-913f-e87c7b8f7cc1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:09.431529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9c7252dd-e540-414b-913f-e87c7b8f7cc1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:09.432245 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9c7252dd-e540-414b-913f-e87c7b8f7cc1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:09.432689 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9c7252dd-e540-414b-913f-e87c7b8f7cc1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:09.433110 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9c7252dd-e540-414b-913f-e87c7b8f7cc1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:09.448801 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e85e6efe-7f50-403a-a052-3a6ec3f54ed3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:09.455477 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e85e6efe-7f50-403a-a052-3a6ec3f54ed3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:09.457332 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e85e6efe-7f50-403a-a052-3a6ec3f54ed3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:09.458042 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e85e6efe-7f50-403a-a052-3a6ec3f54ed3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:09.458706 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e85e6efe-7f50-403a-a052-3a6ec3f54ed3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:09.459397 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e85e6efe-7f50-403a-a052-3a6ec3f54ed3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:09.459935 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e85e6efe-7f50-403a-a052-3a6ec3f54ed3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:09.460536 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e85e6efe-7f50-403a-a052-3a6ec3f54ed3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:09.578081 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-9c7252dd-e540-414b-913f-e87c7b8f7cc1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:09.587669 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-9c7252dd-e540-414b-913f-e87c7b8f7cc1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1367 microversion: 2.1 time: 0.167897 Sep 09 12:57:09.588238 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 42/86] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:09 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:09.603894 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e85e6efe-7f50-403a-a052-3a6ec3f54ed3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:09.612513 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e85e6efe-7f50-403a-a052-3a6ec3f54ed3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:09.614210 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e85e6efe-7f50-403a-a052-3a6ec3f54ed3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:09.615338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e85e6efe-7f50-403a-a052-3a6ec3f54ed3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1407 microversion: 2.20 time: 0.171097 Sep 09 12:57:09.616284 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 45/87] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:57:09 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:57:10.037587 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-918e9838-e1f8-4701-b730-f34a867dc8a0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:10.038208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-918e9838-e1f8-4701-b730-f34a867dc8a0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:10.045216 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-918e9838-e1f8-4701-b730-f34a867dc8a0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:10.045216 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-918e9838-e1f8-4701-b730-f34a867dc8a0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:10.045216 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-918e9838-e1f8-4701-b730-f34a867dc8a0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:10.045788 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-918e9838-e1f8-4701-b730-f34a867dc8a0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:10.046412 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-918e9838-e1f8-4701-b730-f34a867dc8a0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:10.047010 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-918e9838-e1f8-4701-b730-f34a867dc8a0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:10.226098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-918e9838-e1f8-4701-b730-f34a867dc8a0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:10.237445 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-918e9838-e1f8-4701-b730-f34a867dc8a0 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1315 microversion: 2.1 time: 0.204165 Sep 09 12:57:10.238378 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 43/88] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:10 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:10.611158 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-166ec4c9-4104-4420-ab17-d9c87c08c8ef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:10.612313 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-166ec4c9-4104-4420-ab17-d9c87c08c8ef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:10.619612 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-166ec4c9-4104-4420-ab17-d9c87c08c8ef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:10.620264 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-166ec4c9-4104-4420-ab17-d9c87c08c8ef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:10.620808 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-166ec4c9-4104-4420-ab17-d9c87c08c8ef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:10.621653 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-166ec4c9-4104-4420-ab17-d9c87c08c8ef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:10.622318 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-166ec4c9-4104-4420-ab17-d9c87c08c8ef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:10.622870 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-166ec4c9-4104-4420-ab17-d9c87c08c8ef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:10.642448 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-743a5b39-012d-4c47-aca7-34aca3c086c7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:10.643701 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-743a5b39-012d-4c47-aca7-34aca3c086c7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:10.659644 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-743a5b39-012d-4c47-aca7-34aca3c086c7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:10.663596 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-743a5b39-012d-4c47-aca7-34aca3c086c7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:10.663596 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-743a5b39-012d-4c47-aca7-34aca3c086c7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:10.663596 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-743a5b39-012d-4c47-aca7-34aca3c086c7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:10.664437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-743a5b39-012d-4c47-aca7-34aca3c086c7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:10.665396 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-743a5b39-012d-4c47-aca7-34aca3c086c7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:10.961252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-743a5b39-012d-4c47-aca7-34aca3c086c7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:10.973288 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-743a5b39-012d-4c47-aca7-34aca3c086c7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:10.975332 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-743a5b39-012d-4c47-aca7-34aca3c086c7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:10.978159 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-743a5b39-012d-4c47-aca7-34aca3c086c7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1407 microversion: 2.20 time: 0.341095 Sep 09 12:57:11.003578 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 44/89] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:57:10 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1407 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:57:11.238678 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-166ec4c9-4104-4420-ab17-d9c87c08c8ef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:11.243728 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-166ec4c9-4104-4420-ab17-d9c87c08c8ef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1367 microversion: 2.1 time: 0.636473 Sep 09 12:57:11.244424 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 46/90] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:10 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1367 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:57:11.266238 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-de77e141-ca5c-482d-8478-ffea48132b78 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:11.267181 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-de77e141-ca5c-482d-8478-ffea48132b78 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:11.274158 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-de77e141-ca5c-482d-8478-ffea48132b78 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:11.280381 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-de77e141-ca5c-482d-8478-ffea48132b78 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:11.280647 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-de77e141-ca5c-482d-8478-ffea48132b78 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:11.281483 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-de77e141-ca5c-482d-8478-ffea48132b78 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:11.282172 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-de77e141-ca5c-482d-8478-ffea48132b78 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:11.282844 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-de77e141-ca5c-482d-8478-ffea48132b78 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:11.446755 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-de77e141-ca5c-482d-8478-ffea48132b78 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:11.454775 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-de77e141-ca5c-482d-8478-ffea48132b78 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1315 microversion: 2.1 time: 0.193151 Sep 09 12:57:11.459315 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 45/91] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:11 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:12.014004 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c19ddf6e-dbaf-45a7-a0ba-738ef6c64995 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:12.017245 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-c19ddf6e-dbaf-45a7-a0ba-738ef6c64995 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:12.045271 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c19ddf6e-dbaf-45a7-a0ba-738ef6c64995 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:12.047102 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c19ddf6e-dbaf-45a7-a0ba-738ef6c64995 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:12.048367 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c19ddf6e-dbaf-45a7-a0ba-738ef6c64995 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:12.053474 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c19ddf6e-dbaf-45a7-a0ba-738ef6c64995 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:12.061511 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c19ddf6e-dbaf-45a7-a0ba-738ef6c64995 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:12.061511 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c19ddf6e-dbaf-45a7-a0ba-738ef6c64995 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:12.251620 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-7b034073-bf37-4008-a098-7ef297bbc40b req-b4f4acfb-3876-49ee-9d13-7ab556e8c972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78dad9a3-ac85-4014-829c-986cca18c8b1", "name": "network-vif-plugged", "status": "completed", "tag": "244f1be5-c384-494f-b53f-53fb6f1b2689"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:57:12.262635 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-7b034073-bf37-4008-a098-7ef297bbc40b req-b4f4acfb-3876-49ee-9d13-7ab556e8c972 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:12.263195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-7b034073-bf37-4008-a098-7ef297bbc40b req-b4f4acfb-3876-49ee-9d13-7ab556e8c972 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:12.263685 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-7b034073-bf37-4008-a098-7ef297bbc40b req-b4f4acfb-3876-49ee-9d13-7ab556e8c972 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:12.273310 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c19ddf6e-dbaf-45a7-a0ba-738ef6c64995 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:12.277171 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-7b034073-bf37-4008-a098-7ef297bbc40b req-b4f4acfb-3876-49ee-9d13-7ab556e8c972 service nova] Creating event network-vif-plugged:244f1be5-c384-494f-b53f-53fb6f1b2689 for instance 78dad9a3-ac85-4014-829c-986cca18c8b1 on hv-cinder-81322 Sep 09 12:57:12.279858 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c19ddf6e-dbaf-45a7-a0ba-738ef6c64995 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:12.281411 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c19ddf6e-dbaf-45a7-a0ba-738ef6c64995 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:12.282558 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-7b034073-bf37-4008-a098-7ef297bbc40b req-b4f4acfb-3876-49ee-9d13-7ab556e8c972 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034882 Sep 09 12:57:12.282761 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-c19ddf6e-dbaf-45a7-a0ba-738ef6c64995 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1407 microversion: 2.20 time: 0.277003 Sep 09 12:57:12.284121 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 46/92] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:57:12.298945 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-42c343e0-4426-4daa-9d10-806f33ded7d1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:12.302089 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-42c343e0-4426-4daa-9d10-806f33ded7d1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:12.302898 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 47/93] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:57:12 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:57:12.306956 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-42c343e0-4426-4daa-9d10-806f33ded7d1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:12.307441 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-42c343e0-4426-4daa-9d10-806f33ded7d1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:12.307895 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-42c343e0-4426-4daa-9d10-806f33ded7d1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:12.308661 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-42c343e0-4426-4daa-9d10-806f33ded7d1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:12.309111 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-42c343e0-4426-4daa-9d10-806f33ded7d1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:12.309672 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-42c343e0-4426-4daa-9d10-806f33ded7d1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:12.488675 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-8e8a0bfc-6052-4076-8d4e-32615baed7f1 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:12.490021 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-8e8a0bfc-6052-4076-8d4e-32615baed7f1 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:12.500259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-42c343e0-4426-4daa-9d10-806f33ded7d1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:12.501765 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8e8a0bfc-6052-4076-8d4e-32615baed7f1 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:12.504736 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8e8a0bfc-6052-4076-8d4e-32615baed7f1 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:12.508105 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8e8a0bfc-6052-4076-8d4e-32615baed7f1 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:12.509617 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8e8a0bfc-6052-4076-8d4e-32615baed7f1 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:12.510168 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8e8a0bfc-6052-4076-8d4e-32615baed7f1 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:12.510303 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-42c343e0-4426-4daa-9d10-806f33ded7d1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1367 microversion: 2.1 time: 0.224591 Sep 09 12:57:12.511215 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 47/94] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:12 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:12.511870 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8e8a0bfc-6052-4076-8d4e-32615baed7f1 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:12.720212 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-8e8a0bfc-6052-4076-8d4e-32615baed7f1 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:12.728244 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-8e8a0bfc-6052-4076-8d4e-32615baed7f1 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1315 microversion: 2.1 time: 0.245293 Sep 09 12:57:12.728803 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 48/95] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:12 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:13.309184 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ff2c88df-fdc4-4fe3-98e2-417ca98bffb3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:13.309817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ff2c88df-fdc4-4fe3-98e2-417ca98bffb3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:13.318670 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff2c88df-fdc4-4fe3-98e2-417ca98bffb3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:13.319167 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff2c88df-fdc4-4fe3-98e2-417ca98bffb3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:13.319604 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff2c88df-fdc4-4fe3-98e2-417ca98bffb3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:13.320489 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff2c88df-fdc4-4fe3-98e2-417ca98bffb3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:13.320955 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff2c88df-fdc4-4fe3-98e2-417ca98bffb3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:13.321407 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff2c88df-fdc4-4fe3-98e2-417ca98bffb3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:13.490327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ff2c88df-fdc4-4fe3-98e2-417ca98bffb3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:13.498824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ff2c88df-fdc4-4fe3-98e2-417ca98bffb3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:13.500391 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ff2c88df-fdc4-4fe3-98e2-417ca98bffb3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:13.501609 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ff2c88df-fdc4-4fe3-98e2-417ca98bffb3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1407 microversion: 2.20 time: 0.196358 Sep 09 12:57:13.502272 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 48/96] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:57:13 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:57:13.533075 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-f81133cc-e35d-4e17-a55c-2a8b279eb6b9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:13.533906 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-f81133cc-e35d-4e17-a55c-2a8b279eb6b9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:13.540999 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f81133cc-e35d-4e17-a55c-2a8b279eb6b9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:13.541608 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f81133cc-e35d-4e17-a55c-2a8b279eb6b9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:13.542137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f81133cc-e35d-4e17-a55c-2a8b279eb6b9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:13.542953 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f81133cc-e35d-4e17-a55c-2a8b279eb6b9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:13.543523 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f81133cc-e35d-4e17-a55c-2a8b279eb6b9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:13.544013 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f81133cc-e35d-4e17-a55c-2a8b279eb6b9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:13.686627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-f81133cc-e35d-4e17-a55c-2a8b279eb6b9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:13.697161 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-f81133cc-e35d-4e17-a55c-2a8b279eb6b9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1367 microversion: 2.1 time: 0.167629 Sep 09 12:57:13.710544 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 49/97] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:13 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:13.750900 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ea1dccab-bf03-4c24-81c4-95536f9207d6 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:13.751509 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ea1dccab-bf03-4c24-81c4-95536f9207d6 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:13.758733 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ea1dccab-bf03-4c24-81c4-95536f9207d6 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:13.759226 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ea1dccab-bf03-4c24-81c4-95536f9207d6 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:13.759667 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ea1dccab-bf03-4c24-81c4-95536f9207d6 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:13.760988 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ea1dccab-bf03-4c24-81c4-95536f9207d6 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:13.761445 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ea1dccab-bf03-4c24-81c4-95536f9207d6 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:13.761905 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ea1dccab-bf03-4c24-81c4-95536f9207d6 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:13.901998 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ea1dccab-bf03-4c24-81c4-95536f9207d6 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:13.913560 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ea1dccab-bf03-4c24-81c4-95536f9207d6 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1501 microversion: 2.1 time: 0.166384 Sep 09 12:57:13.915038 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 49/98] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:13 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:14.529958 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-33dcb225-82fb-4500-897d-e5c7bbaadac0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:14.530592 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-33dcb225-82fb-4500-897d-e5c7bbaadac0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:14.537562 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-33dcb225-82fb-4500-897d-e5c7bbaadac0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:14.538173 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-33dcb225-82fb-4500-897d-e5c7bbaadac0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:14.538760 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-33dcb225-82fb-4500-897d-e5c7bbaadac0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:14.539753 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-33dcb225-82fb-4500-897d-e5c7bbaadac0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:14.540270 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-33dcb225-82fb-4500-897d-e5c7bbaadac0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:14.540795 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-33dcb225-82fb-4500-897d-e5c7bbaadac0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:14.715131 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-33dcb225-82fb-4500-897d-e5c7bbaadac0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:14.723521 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-6026990f-efb5-4666-bd41-7f136463ec36 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:14.729682 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-6026990f-efb5-4666-bd41-7f136463ec36 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:14.729828 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-33dcb225-82fb-4500-897d-e5c7bbaadac0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:14.729828 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-33dcb225-82fb-4500-897d-e5c7bbaadac0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:14.730702 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-33dcb225-82fb-4500-897d-e5c7bbaadac0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1407 microversion: 2.20 time: 0.207059 Sep 09 12:57:14.731441 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 50/99] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:57:14 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:57:14.739108 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6026990f-efb5-4666-bd41-7f136463ec36 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:14.740380 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6026990f-efb5-4666-bd41-7f136463ec36 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:14.741358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6026990f-efb5-4666-bd41-7f136463ec36 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:14.742531 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6026990f-efb5-4666-bd41-7f136463ec36 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:14.743122 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6026990f-efb5-4666-bd41-7f136463ec36 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:14.743713 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6026990f-efb5-4666-bd41-7f136463ec36 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:14.748550 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=100 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:57:14.904215 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-6026990f-efb5-4666-bd41-7f136463ec36 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:14.913975 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-6026990f-efb5-4666-bd41-7f136463ec36 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1367 microversion: 2.1 time: 0.196480 Sep 09 12:57:14.915618 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 50/100] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:14 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:57:15.757497 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-98a9fec1-417e-476e-99b8-316518758177 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:15.758182 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-98a9fec1-417e-476e-99b8-316518758177 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:15.760357 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=2 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:57:15.765230 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-98a9fec1-417e-476e-99b8-316518758177 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:15.769703 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-98a9fec1-417e-476e-99b8-316518758177 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:15.769703 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-98a9fec1-417e-476e-99b8-316518758177 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:15.769703 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-98a9fec1-417e-476e-99b8-316518758177 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:15.769703 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-98a9fec1-417e-476e-99b8-316518758177 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:15.770239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-98a9fec1-417e-476e-99b8-316518758177 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:15.906451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-98a9fec1-417e-476e-99b8-316518758177 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:15.916978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=100 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:57:15.920471 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-98a9fec1-417e-476e-99b8-316518758177 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:15.922202 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-98a9fec1-417e-476e-99b8-316518758177 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:15.923737 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-98a9fec1-417e-476e-99b8-316518758177 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1599 microversion: 2.20 time: 0.170297 Sep 09 12:57:15.939078 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 51/101] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:57:15 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1599 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:57:15.941167 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ccd6d90f-05e0-452b-887d-29ea9a32071a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:15.942010 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ccd6d90f-05e0-452b-887d-29ea9a32071a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:15.954566 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-cd5de2dd-b37f-4ae8-8061-d406efa52046 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:15.961491 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ccd6d90f-05e0-452b-887d-29ea9a32071a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:15.962012 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ccd6d90f-05e0-452b-887d-29ea9a32071a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:15.962419 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ccd6d90f-05e0-452b-887d-29ea9a32071a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:15.963150 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ccd6d90f-05e0-452b-887d-29ea9a32071a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:15.964314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ccd6d90f-05e0-452b-887d-29ea9a32071a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:15.965574 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ccd6d90f-05e0-452b-887d-29ea9a32071a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:15.966213 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-cd5de2dd-b37f-4ae8-8061-d406efa52046 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:15.979352 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-cd5de2dd-b37f-4ae8-8061-d406efa52046 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:15.980347 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-cd5de2dd-b37f-4ae8-8061-d406efa52046 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:15.981007 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-cd5de2dd-b37f-4ae8-8061-d406efa52046 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:15.981890 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-cd5de2dd-b37f-4ae8-8061-d406efa52046 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:15.982528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-cd5de2dd-b37f-4ae8-8061-d406efa52046 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:15.984538 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-cd5de2dd-b37f-4ae8-8061-d406efa52046 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:16.147146 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-cd5de2dd-b37f-4ae8-8061-d406efa52046 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.196932 Sep 09 12:57:16.147912 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 52/102] 10.222.0.46 () {60 vars in 1316 bytes} [Fri Sep 9 12:57:15 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1/os-interface => generated 285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 12:57:16.166530 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ccd6d90f-05e0-452b-887d-29ea9a32071a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:16.178930 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ccd6d90f-05e0-452b-887d-29ea9a32071a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1367 microversion: 2.1 time: 0.243268 Sep 09 12:57:16.180249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 51/103] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:15 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:57:16.217964 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-cf25cc95-9c89-49a3-9106-df5eafc3a842 req-d4f501b8-b9e3-489c-89e7-1428cb67ca9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f59545d-0b40-4f82-94e2-789c728a6bed", "name": "network-vif-plugged", "status": "completed", "tag": "7dc91708-0aac-4dd5-b9ff-cd3faa6becbe"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:57:16.228589 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-cf25cc95-9c89-49a3-9106-df5eafc3a842 req-d4f501b8-b9e3-489c-89e7-1428cb67ca9a service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:16.229521 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-cf25cc95-9c89-49a3-9106-df5eafc3a842 req-d4f501b8-b9e3-489c-89e7-1428cb67ca9a service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:16.230197 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-cf25cc95-9c89-49a3-9106-df5eafc3a842 req-d4f501b8-b9e3-489c-89e7-1428cb67ca9a service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:16.241794 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-cf25cc95-9c89-49a3-9106-df5eafc3a842 req-d4f501b8-b9e3-489c-89e7-1428cb67ca9a service nova] Creating event network-vif-plugged:7dc91708-0aac-4dd5-b9ff-cd3faa6becbe for instance 7f59545d-0b40-4f82-94e2-789c728a6bed on hv-cinder-81322 Sep 09 12:57:16.247101 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-cf25cc95-9c89-49a3-9106-df5eafc3a842 req-d4f501b8-b9e3-489c-89e7-1428cb67ca9a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034313 Sep 09 12:57:16.247804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 53/104] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:57:16.947875 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-96bd1410-7549-4c8a-8cc8-c3b50f1b7902 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "946f762e-805f-4003-b88d-5d0cacc8e747"}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:57:16.955822 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-96bd1410-7549-4c8a-8cc8-c3b50f1b7902 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:16.966360 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-96bd1410-7549-4c8a-8cc8-c3b50f1b7902 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:16.984140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-96bd1410-7549-4c8a-8cc8-c3b50f1b7902 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:16.984790 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-96bd1410-7549-4c8a-8cc8-c3b50f1b7902 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:16.986270 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-96bd1410-7549-4c8a-8cc8-c3b50f1b7902 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:16.995333 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-96bd1410-7549-4c8a-8cc8-c3b50f1b7902 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:16.995333 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-96bd1410-7549-4c8a-8cc8-c3b50f1b7902 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:17.213897 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-dda634b0-3451-4df7-8ebf-cfe994d657da tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:17.214556 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-dda634b0-3451-4df7-8ebf-cfe994d657da tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:17.221114 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dda634b0-3451-4df7-8ebf-cfe994d657da tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:17.221609 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dda634b0-3451-4df7-8ebf-cfe994d657da tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:17.222580 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dda634b0-3451-4df7-8ebf-cfe994d657da tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:17.223780 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dda634b0-3451-4df7-8ebf-cfe994d657da tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:17.224701 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dda634b0-3451-4df7-8ebf-cfe994d657da tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:17.225330 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dda634b0-3451-4df7-8ebf-cfe994d657da tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:17.458338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-dda634b0-3451-4df7-8ebf-cfe994d657da tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:17.466273 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-dda634b0-3451-4df7-8ebf-cfe994d657da tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1367 microversion: 2.1 time: 0.258525 Sep 09 12:57:17.467479 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 54/105] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:17 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:57:17.995994 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-2c5fd09a-04b7-4ffa-9dc4-8d759e923c5a req-290d5283-4ea2-414c-b9d3-6f842c0d6d07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78dad9a3-ac85-4014-829c-986cca18c8b1", "tag": "244f1be5-c384-494f-b53f-53fb6f1b2689"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:57:18.007626 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-2c5fd09a-04b7-4ffa-9dc4-8d759e923c5a req-290d5283-4ea2-414c-b9d3-6f842c0d6d07 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:18.008101 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-2c5fd09a-04b7-4ffa-9dc4-8d759e923c5a req-290d5283-4ea2-414c-b9d3-6f842c0d6d07 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:18.008566 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-2c5fd09a-04b7-4ffa-9dc4-8d759e923c5a req-290d5283-4ea2-414c-b9d3-6f842c0d6d07 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:18.022928 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-2c5fd09a-04b7-4ffa-9dc4-8d759e923c5a req-290d5283-4ea2-414c-b9d3-6f842c0d6d07 service nova] Creating event network-changed:244f1be5-c384-494f-b53f-53fb6f1b2689 for instance 78dad9a3-ac85-4014-829c-986cca18c8b1 on hv-cinder-81322 Sep 09 12:57:18.028883 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-2c5fd09a-04b7-4ffa-9dc4-8d759e923c5a req-290d5283-4ea2-414c-b9d3-6f842c0d6d07 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036689 Sep 09 12:57:18.029559 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 55/106] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:57:18.479793 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-96bd1410-7549-4c8a-8cc8-c3b50f1b7902 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "POST /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.535911 Sep 09 12:57:18.482086 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 52/107] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 12:57:16 2022] POST /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9/os-volume_attachments => generated 194 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:57:18.495757 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-122cd971-4634-4d1a-996b-f49bd1824c9d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:18.496911 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-122cd971-4634-4d1a-996b-f49bd1824c9d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:18.507417 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-122cd971-4634-4d1a-996b-f49bd1824c9d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:18.509255 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-122cd971-4634-4d1a-996b-f49bd1824c9d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:18.509255 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-122cd971-4634-4d1a-996b-f49bd1824c9d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:18.510734 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-122cd971-4634-4d1a-996b-f49bd1824c9d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:18.511356 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-122cd971-4634-4d1a-996b-f49bd1824c9d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:18.511776 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-122cd971-4634-4d1a-996b-f49bd1824c9d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:19.260877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-122cd971-4634-4d1a-996b-f49bd1824c9d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:19.279086 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-122cd971-4634-4d1a-996b-f49bd1824c9d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1367 microversion: 2.1 time: 0.781326 Sep 09 12:57:19.280067 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 56/108] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:18 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1367 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:20.305771 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d7fd2833-f4f7-4bae-b365-09ec7b409dd9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:20.306594 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-d7fd2833-f4f7-4bae-b365-09ec7b409dd9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:20.313252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d7fd2833-f4f7-4bae-b365-09ec7b409dd9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:20.313732 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d7fd2833-f4f7-4bae-b365-09ec7b409dd9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:20.314267 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d7fd2833-f4f7-4bae-b365-09ec7b409dd9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:20.314886 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d7fd2833-f4f7-4bae-b365-09ec7b409dd9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:20.315340 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d7fd2833-f4f7-4bae-b365-09ec7b409dd9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:20.316916 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d7fd2833-f4f7-4bae-b365-09ec7b409dd9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:20.486662 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-d7fd2833-f4f7-4bae-b365-09ec7b409dd9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:20.496354 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d7fd2833-f4f7-4bae-b365-09ec7b409dd9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1558 microversion: 2.1 time: 0.195844 Sep 09 12:57:20.511196 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 53/109] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:20 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1558 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:20.527545 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-b44233ec-5334-4baf-bcbe-83ae6ebecfef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:20.528721 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-b44233ec-5334-4baf-bcbe-83ae6ebecfef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:20.536640 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b44233ec-5334-4baf-bcbe-83ae6ebecfef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:20.537250 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b44233ec-5334-4baf-bcbe-83ae6ebecfef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:20.537576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b44233ec-5334-4baf-bcbe-83ae6ebecfef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:20.538268 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b44233ec-5334-4baf-bcbe-83ae6ebecfef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:20.538747 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b44233ec-5334-4baf-bcbe-83ae6ebecfef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:20.539186 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b44233ec-5334-4baf-bcbe-83ae6ebecfef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:20.624889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-b44233ec-5334-4baf-bcbe-83ae6ebecfef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101113 Sep 09 12:57:20.625558 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 57/110] 10.222.0.46 () {58 vars in 1275 bytes} [Fri Sep 9 12:57:20 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:57:23.135086 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-f1cc3316-0388-4969-8f2d-8e00998f2224 req-584e29c7-240f-4557-8708-931dd2b866e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f59545d-0b40-4f82-94e2-789c728a6bed", "tag": "7dc91708-0aac-4dd5-b9ff-cd3faa6becbe"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:57:23.148592 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-f1cc3316-0388-4969-8f2d-8e00998f2224 req-584e29c7-240f-4557-8708-931dd2b866e7 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:23.149475 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-f1cc3316-0388-4969-8f2d-8e00998f2224 req-584e29c7-240f-4557-8708-931dd2b866e7 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:23.149994 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-f1cc3316-0388-4969-8f2d-8e00998f2224 req-584e29c7-240f-4557-8708-931dd2b866e7 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:23.168338 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-f1cc3316-0388-4969-8f2d-8e00998f2224 req-584e29c7-240f-4557-8708-931dd2b866e7 service nova] Creating event network-changed:7dc91708-0aac-4dd5-b9ff-cd3faa6becbe for instance 7f59545d-0b40-4f82-94e2-789c728a6bed on hv-cinder-81322 Sep 09 12:57:23.173695 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-f1cc3316-0388-4969-8f2d-8e00998f2224 req-584e29c7-240f-4557-8708-931dd2b866e7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.642058 Sep 09 12:57:23.174652 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 54/111] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:57:28.726136 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-fed5f1fa-2bb1-4129-9d49-79ee714c3722 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:28.726683 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-fed5f1fa-2bb1-4129-9d49-79ee714c3722 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:28.732645 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fed5f1fa-2bb1-4129-9d49-79ee714c3722 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:28.733170 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fed5f1fa-2bb1-4129-9d49-79ee714c3722 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:28.733680 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fed5f1fa-2bb1-4129-9d49-79ee714c3722 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:28.734378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fed5f1fa-2bb1-4129-9d49-79ee714c3722 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:28.735121 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fed5f1fa-2bb1-4129-9d49-79ee714c3722 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:28.735548 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fed5f1fa-2bb1-4129-9d49-79ee714c3722 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:28.770278 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-fed5f1fa-2bb1-4129-9d49-79ee714c3722 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Going to try to terminate instance {{(pid=127772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:57:29.048723 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-fed5f1fa-2bb1-4129-9d49-79ee714c3722 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 204 len: 0 microversion: 2.1 time: 0.326959 Sep 09 12:57:29.049587 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 58/112] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 12:57:28 2022] DELETE /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 12:57:29.059455 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e7049c88-d4ab-4b7b-bfac-ccb91088f5b3 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:29.060813 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-e7049c88-d4ab-4b7b-bfac-ccb91088f5b3 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:29.067086 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e7049c88-d4ab-4b7b-bfac-ccb91088f5b3 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:29.067562 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e7049c88-d4ab-4b7b-bfac-ccb91088f5b3 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:29.067991 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e7049c88-d4ab-4b7b-bfac-ccb91088f5b3 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:29.068677 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e7049c88-d4ab-4b7b-bfac-ccb91088f5b3 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:29.069271 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e7049c88-d4ab-4b7b-bfac-ccb91088f5b3 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:29.069840 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e7049c88-d4ab-4b7b-bfac-ccb91088f5b3 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:29.209747 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e7049c88-d4ab-4b7b-bfac-ccb91088f5b3 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:29.218192 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-e7049c88-d4ab-4b7b-bfac-ccb91088f5b3 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1553 microversion: 2.1 time: 0.163334 Sep 09 12:57:29.219005 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 55/113] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:29 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:30.242678 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-124be59e-5a26-4423-bd94-8c76c7a32e5b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:30.243480 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-124be59e-5a26-4423-bd94-8c76c7a32e5b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:30.250599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-124be59e-5a26-4423-bd94-8c76c7a32e5b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:30.251774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-124be59e-5a26-4423-bd94-8c76c7a32e5b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:30.252366 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-124be59e-5a26-4423-bd94-8c76c7a32e5b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:30.256601 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-124be59e-5a26-4423-bd94-8c76c7a32e5b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:30.257242 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-124be59e-5a26-4423-bd94-8c76c7a32e5b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:30.257750 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-124be59e-5a26-4423-bd94-8c76c7a32e5b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:30.446830 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-124be59e-5a26-4423-bd94-8c76c7a32e5b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:30.455966 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-124be59e-5a26-4423-bd94-8c76c7a32e5b tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1553 microversion: 2.1 time: 0.217982 Sep 09 12:57:30.457716 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 59/114] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:30 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1553 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:31.480230 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-5a7071e7-596c-45f9-bc30-50dc017e5b19 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:31.481754 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-5a7071e7-596c-45f9-bc30-50dc017e5b19 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:31.493669 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a7071e7-596c-45f9-bc30-50dc017e5b19 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:31.493669 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a7071e7-596c-45f9-bc30-50dc017e5b19 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:31.493669 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a7071e7-596c-45f9-bc30-50dc017e5b19 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:31.493669 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a7071e7-596c-45f9-bc30-50dc017e5b19 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:31.494233 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a7071e7-596c-45f9-bc30-50dc017e5b19 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:31.494233 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a7071e7-596c-45f9-bc30-50dc017e5b19 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:31.774699 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-5a7071e7-596c-45f9-bc30-50dc017e5b19 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:31.796644 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-5a7071e7-596c-45f9-bc30-50dc017e5b19 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1553 microversion: 2.1 time: 0.317139 Sep 09 12:57:31.797948 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 56/115] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:31 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1553 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:32.338020 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-f89de044-0fd6-4a40-9d82-7f8a3acfde17 req-929f225c-a3b1-464d-83bc-526857116281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f10f11-bf68-4455-85ee-f551c7742ee9", "name": "network-vif-deleted", "tag": "d60b84b9-cc3d-43da-a44b-2752f25ecee4"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:57:32.353453 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-f89de044-0fd6-4a40-9d82-7f8a3acfde17 req-929f225c-a3b1-464d-83bc-526857116281 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:32.353938 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-f89de044-0fd6-4a40-9d82-7f8a3acfde17 req-929f225c-a3b1-464d-83bc-526857116281 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:32.354526 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-f89de044-0fd6-4a40-9d82-7f8a3acfde17 req-929f225c-a3b1-464d-83bc-526857116281 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:32.367162 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-f89de044-0fd6-4a40-9d82-7f8a3acfde17 req-929f225c-a3b1-464d-83bc-526857116281 service nova] Creating event network-vif-deleted:d60b84b9-cc3d-43da-a44b-2752f25ecee4 for instance a3f10f11-bf68-4455-85ee-f551c7742ee9 on hv-cinder-81322 Sep 09 12:57:32.372166 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-f89de044-0fd6-4a40-9d82-7f8a3acfde17 req-929f225c-a3b1-464d-83bc-526857116281 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038142 Sep 09 12:57:32.382587 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 60/116] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:57:32.823628 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-3fe94838-195b-4c6b-a516-3779c2af2f58 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:32.824929 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-3fe94838-195b-4c6b-a516-3779c2af2f58 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:32.831772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3fe94838-195b-4c6b-a516-3779c2af2f58 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:32.833069 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3fe94838-195b-4c6b-a516-3779c2af2f58 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:32.833812 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3fe94838-195b-4c6b-a516-3779c2af2f58 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:32.835126 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3fe94838-195b-4c6b-a516-3779c2af2f58 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:32.835955 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3fe94838-195b-4c6b-a516-3779c2af2f58 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:32.836520 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3fe94838-195b-4c6b-a516-3779c2af2f58 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:32.911959 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-3fe94838-195b-4c6b-a516-3779c2af2f58 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:32.922797 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-3fe94838-195b-4c6b-a516-3779c2af2f58 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1346 microversion: 2.1 time: 0.103131 Sep 09 12:57:32.923376 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 57/117] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:32 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:33.946253 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7a5f3ef3-8d83-4681-b0ab-82a59d9aba28 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:33.946988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7a5f3ef3-8d83-4681-b0ab-82a59d9aba28 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:33.953971 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a5f3ef3-8d83-4681-b0ab-82a59d9aba28 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:33.954614 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a5f3ef3-8d83-4681-b0ab-82a59d9aba28 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:33.955062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a5f3ef3-8d83-4681-b0ab-82a59d9aba28 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:33.955774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a5f3ef3-8d83-4681-b0ab-82a59d9aba28 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:33.956235 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a5f3ef3-8d83-4681-b0ab-82a59d9aba28 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:33.956847 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a5f3ef3-8d83-4681-b0ab-82a59d9aba28 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:34.002837 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a5f3ef3-8d83-4681-b0ab-82a59d9aba28 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:34.003326 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a5f3ef3-8d83-4681-b0ab-82a59d9aba28 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:34.003760 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a5f3ef3-8d83-4681-b0ab-82a59d9aba28 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:34.004420 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.objects.instance [None req-7a5f3ef3-8d83-4681-b0ab-82a59d9aba28 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lazy-loading 'fault' on Instance uuid a3f10f11-bf68-4455-85ee-f551c7742ee9 {{(pid=127772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:57:34.050166 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7a5f3ef3-8d83-4681-b0ab-82a59d9aba28 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71eb53fc47c4f82add6fdd3d469230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2a31fedb6843ba8ffea570a374acf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:34.058145 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7a5f3ef3-8d83-4681-b0ab-82a59d9aba28 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 200 len: 1305 microversion: 2.1 time: 0.116034 Sep 09 12:57:34.058704 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 61/118] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:33 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 1305 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:35.084289 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-084d81d1-c4da-4eaf-a2bc-6a2767734f94 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:35.084824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-084d81d1-c4da-4eaf-a2bc-6a2767734f94 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:35.091253 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-084d81d1-c4da-4eaf-a2bc-6a2767734f94 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:35.091733 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-084d81d1-c4da-4eaf-a2bc-6a2767734f94 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:35.092171 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-084d81d1-c4da-4eaf-a2bc-6a2767734f94 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:35.092853 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-084d81d1-c4da-4eaf-a2bc-6a2767734f94 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:35.093304 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-084d81d1-c4da-4eaf-a2bc-6a2767734f94 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:35.093725 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-084d81d1-c4da-4eaf-a2bc-6a2767734f94 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:35.107554 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-084d81d1-c4da-4eaf-a2bc-6a2767734f94 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] HTTP exception thrown: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. Sep 09 12:57:35.112142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-084d81d1-c4da-4eaf-a2bc-6a2767734f94 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Request method failure captured: Sep 09 12:57:35.112142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 HTTP/1.1 Sep 09 12:57:35.112142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 12:57:35.112142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 12:57:35.112142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 12:57:35.112142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 12:57:35.112142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 12:57:35.112142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 12:57:35.112142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 12:57:35.112142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 12:57:35.112142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzgE0C91kJzdWDPL8HEI1DO_KyoQf4kT7wJNcvczpLnThylRa4ipuoc-_lqDPGjXNkphI9pNXMh2Lfnj5kT_6Fi_JgameK0HJ8jgkad5Sinm82fnNPF1lbrgLYfSzxI5A1E09QwvPKEZOqov1677Fe1qlfQO9DekbFBRo76JUs1L11E Sep 09 12:57:35.112142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 12:57:35.112142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 12:57:35.112142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 12:57:35.112142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 12:57:35.112142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 12:57:35.112142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 12:57:35.112142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: 9c2a31fedb6843ba8ffea570a374acf5 Sep 09 12:57:35.112142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-DeleteServersTestJSON-1554839643 Sep 09 12:57:35.112142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 12:57:35.112142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 12:57:35.113656 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9c2a31fedb6843ba8ffea570a374acf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9c2a31fedb6843ba8ffea570a374acf5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c2a31fedb6843ba8ffea570a374acf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c2a31fedb6843ba8ffea570a374acf5"}]}] Sep 09 12:57:35.113656 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-DeleteServersTestJSON-1554839643 Sep 09 12:57:35.113656 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: 9c2a31fedb6843ba8ffea570a374acf5 Sep 09 12:57:35.113656 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-DeleteServersTestJSON-1554839643 Sep 09 12:57:35.113656 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-DeleteServersTestJSON-1554839643-project Sep 09 12:57:35.113656 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 12:57:35.113656 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 12:57:35.113656 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: c71eb53fc47c4f82add6fdd3d469230e Sep 09 12:57:35.113656 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-DeleteServersTestJSON-1554839643-project Sep 09 12:57:35.113656 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 12:57:35.113656 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. Sep 09 12:57:35.113656 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': 'a3f10f11-bf68-4455-85ee-f551c7742ee9'} Sep 09 12:57:35.114508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:57:35.114508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:57:35.114508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:57:35.114508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:57:35.114508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:57:35.114508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:57:35.114508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:57:35.114508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:57:35.114508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:57:35.114508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:57:35.114508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. Sep 09 12:57:35.114508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:57:35.114508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:57:35.114508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:57:35.114508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:57:35.114508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:57:35.114508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:57:35.114508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:57:35.114508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:57:35.114508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:57:35.115871 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:57:35.115871 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:57:35.115871 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:57:35.115871 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:57:35.115871 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:57:35.115871 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:57:35.115871 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:57:35.115871 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. Sep 09 12:57:35.115871 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:57:35.115871 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:57:35.115871 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:57:35.115871 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:57:35.115871 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:57:35.115871 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:57:35.115871 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:57:35.115871 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:57:35.115871 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. Sep 09 12:57:35.115871 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:57:35.116892 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-084d81d1-c4da-4eaf-a2bc-6a2767734f94 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Returning 404 to user: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:57:35.116892 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-084d81d1-c4da-4eaf-a2bc-6a2767734f94 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 404 len: 111 microversion: 2.1 time: 0.034344 Sep 09 12:57:35.116892 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 58/119] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:35 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:57:35.242528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-6c5d6833-5061-4672-825b-a53cb50d6a6d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:35.244880 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-6c5d6833-5061-4672-825b-a53cb50d6a6d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:35.251971 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6c5d6833-5061-4672-825b-a53cb50d6a6d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:35.252479 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6c5d6833-5061-4672-825b-a53cb50d6a6d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:35.252914 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6c5d6833-5061-4672-825b-a53cb50d6a6d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:35.253680 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6c5d6833-5061-4672-825b-a53cb50d6a6d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:35.254847 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6c5d6833-5061-4672-825b-a53cb50d6a6d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:35.255281 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6c5d6833-5061-4672-825b-a53cb50d6a6d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:35.268385 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-6c5d6833-5061-4672-825b-a53cb50d6a6d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] HTTP exception thrown: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. Sep 09 12:57:35.272988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-6c5d6833-5061-4672-825b-a53cb50d6a6d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Request method failure captured: Sep 09 12:57:35.272988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9/os-volume_attachments HTTP/1.1 Sep 09 12:57:35.272988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 12:57:35.272988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 12:57:35.272988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 12:57:35.272988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 12:57:35.272988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 12:57:35.272988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 12:57:35.272988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 12:57:35.272988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 12:57:35.272988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGzgE0C91kJzdWDPL8HEI1DO_KyoQf4kT7wJNcvczpLnThylRa4ipuoc-_lqDPGjXNkphI9pNXMh2Lfnj5kT_6Fi_JgameK0HJ8jgkad5Sinm82fnNPF1lbrgLYfSzxI5A1E09QwvPKEZOqov1677Fe1qlfQO9DekbFBRo76JUs1L11E Sep 09 12:57:35.272988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 12:57:35.272988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 12:57:35.272988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 12:57:35.272988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 12:57:35.272988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 12:57:35.272988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 12:57:35.272988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: 9c2a31fedb6843ba8ffea570a374acf5 Sep 09 12:57:35.272988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-DeleteServersTestJSON-1554839643 Sep 09 12:57:35.272988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 12:57:35.272988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 12:57:35.274338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9c2a31fedb6843ba8ffea570a374acf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9c2a31fedb6843ba8ffea570a374acf5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c2a31fedb6843ba8ffea570a374acf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c2a31fedb6843ba8ffea570a374acf5"}]}] Sep 09 12:57:35.274338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-DeleteServersTestJSON-1554839643 Sep 09 12:57:35.274338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: 9c2a31fedb6843ba8ffea570a374acf5 Sep 09 12:57:35.274338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-DeleteServersTestJSON-1554839643 Sep 09 12:57:35.274338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-DeleteServersTestJSON-1554839643-project Sep 09 12:57:35.274338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 12:57:35.274338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 12:57:35.274338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: c71eb53fc47c4f82add6fdd3d469230e Sep 09 12:57:35.274338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-DeleteServersTestJSON-1554839643-project Sep 09 12:57:35.274338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: > Sep 09 12:57:35.274338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. Sep 09 12:57:35.274338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'server_id': 'a3f10f11-bf68-4455-85ee-f551c7742ee9'} Sep 09 12:57:35.275218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:57:35.275218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:57:35.275218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:57:35.275218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:57:35.275218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:57:35.275218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:57:35.275218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:57:35.275218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:57:35.275218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:57:35.275218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:57:35.275218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. Sep 09 12:57:35.275218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:57:35.275218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:57:35.275218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:57:35.275218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:57:35.275218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:57:35.275218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:57:35.275218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:57:35.275218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:57:35.275218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:57:35.276263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:57:35.276263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 12:57:35.276263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:57:35.276263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 12:57:35.276263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:57:35.276263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 09 12:57:35.276263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 09 12:57:35.276263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:57:35.276263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:57:35.276263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. Sep 09 12:57:35.276263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:57:35.276263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:57:35.276263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:57:35.276263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:57:35.276263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:57:35.276263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:57:35.276263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:57:35.276263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:57:35.276263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. Sep 09 12:57:35.276263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:57:35.277554 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-6c5d6833-5061-4672-825b-a53cb50d6a6d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Returning 404 to user: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:57:35.277554 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-6c5d6833-5061-4672-825b-a53cb50d6a6d tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037253 Sep 09 12:57:35.277554 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 62/120] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 12:57:35 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:57:36.693256 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-5bca3719-20d2-487a-93a1-2329df8baa98 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:36.694362 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-5bca3719-20d2-487a-93a1-2329df8baa98 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:36.701136 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5bca3719-20d2-487a-93a1-2329df8baa98 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:36.701783 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5bca3719-20d2-487a-93a1-2329df8baa98 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:36.702297 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5bca3719-20d2-487a-93a1-2329df8baa98 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:36.703337 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5bca3719-20d2-487a-93a1-2329df8baa98 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:36.704203 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5bca3719-20d2-487a-93a1-2329df8baa98 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:36.704804 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5bca3719-20d2-487a-93a1-2329df8baa98 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:36.725776 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-5bca3719-20d2-487a-93a1-2329df8baa98 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] HTTP exception thrown: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. Sep 09 12:57:36.727774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-5bca3719-20d2-487a-93a1-2329df8baa98 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Request method failure captured: Sep 09 12:57:36.727774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: DELETE /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 HTTP/1.1 Sep 09 12:57:36.727774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 12:57:36.727774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 12:57:36.727774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 12:57:36.727774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 12:57:36.727774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 12:57:36.727774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 12:57:36.727774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 12:57:36.727774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 12:57:36.727774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzgE0C91kJzdWDPL8HEI1DO_KyoQf4kT7wJNcvczpLnThylRa4ipuoc-_lqDPGjXNkphI9pNXMh2Lfnj5kT_6Fi_JgameK0HJ8jgkad5Sinm82fnNPF1lbrgLYfSzxI5A1E09QwvPKEZOqov1677Fe1qlfQO9DekbFBRo76JUs1L11E Sep 09 12:57:36.727774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 12:57:36.727774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 12:57:36.727774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 12:57:36.727774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 12:57:36.727774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 12:57:36.727774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 12:57:36.727774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: 9c2a31fedb6843ba8ffea570a374acf5 Sep 09 12:57:36.727774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-DeleteServersTestJSON-1554839643 Sep 09 12:57:36.727774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 12:57:36.727774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 12:57:36.734695 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9c2a31fedb6843ba8ffea570a374acf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9c2a31fedb6843ba8ffea570a374acf5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c2a31fedb6843ba8ffea570a374acf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c2a31fedb6843ba8ffea570a374acf5"}]}] Sep 09 12:57:36.734695 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-DeleteServersTestJSON-1554839643 Sep 09 12:57:36.734695 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: 9c2a31fedb6843ba8ffea570a374acf5 Sep 09 12:57:36.734695 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-DeleteServersTestJSON-1554839643 Sep 09 12:57:36.734695 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-DeleteServersTestJSON-1554839643-project Sep 09 12:57:36.734695 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 12:57:36.734695 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 12:57:36.734695 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: c71eb53fc47c4f82add6fdd3d469230e Sep 09 12:57:36.734695 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-DeleteServersTestJSON-1554839643-project Sep 09 12:57:36.734695 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 12:57:36.734695 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. Sep 09 12:57:36.734695 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': 'a3f10f11-bf68-4455-85ee-f551c7742ee9'} Sep 09 12:57:36.735334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:57:36.735334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:57:36.735334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:57:36.735334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:57:36.735334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:57:36.735334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:57:36.735334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:57:36.735334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:57:36.735334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:57:36.735334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:57:36.735334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. Sep 09 12:57:36.735334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:57:36.735334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:57:36.735334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:57:36.735334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:57:36.735334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:57:36.735334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:57:36.735334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:57:36.735334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:57:36.735334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:57:36.736358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:57:36.736358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 12:57:36.736358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 12:57:36.736358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 12:57:36.736358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 12:57:36.736358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:57:36.736358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:57:36.736358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:57:36.736358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:57:36.736358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. Sep 09 12:57:36.736358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:57:36.736358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:57:36.736358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:57:36.736358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:57:36.736358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:57:36.736358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:57:36.736358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:57:36.736358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:57:36.736358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. Sep 09 12:57:36.736358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:57:36.738497 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-5bca3719-20d2-487a-93a1-2329df8baa98 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Returning 404 to user: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:57:36.738497 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-5bca3719-20d2-487a-93a1-2329df8baa98 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 404 len: 111 microversion: 2.1 time: 0.041391 Sep 09 12:57:36.738497 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 59/121] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 12:57:36 2022] DELETE /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:57:36.739211 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-08329111-3c35-410c-9b20-b3e5c7adc1b8 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:36.739632 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-08329111-3c35-410c-9b20-b3e5c7adc1b8 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] [instance: a3f10f11-bf68-4455-85ee-f551c7742ee9] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:36.742300 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:57:36.745689 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-08329111-3c35-410c-9b20-b3e5c7adc1b8 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:36.746176 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-08329111-3c35-410c-9b20-b3e5c7adc1b8 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:36.746641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-08329111-3c35-410c-9b20-b3e5c7adc1b8 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:36.747337 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-08329111-3c35-410c-9b20-b3e5c7adc1b8 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:36.747794 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-08329111-3c35-410c-9b20-b3e5c7adc1b8 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:36.748218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-08329111-3c35-410c-9b20-b3e5c7adc1b8 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:36.762846 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-08329111-3c35-410c-9b20-b3e5c7adc1b8 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] HTTP exception thrown: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. Sep 09 12:57:36.764978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-08329111-3c35-410c-9b20-b3e5c7adc1b8 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Request method failure captured: Sep 09 12:57:36.764978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 HTTP/1.1 Sep 09 12:57:36.764978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 12:57:36.764978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 12:57:36.764978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 12:57:36.764978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 12:57:36.764978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 12:57:36.764978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 12:57:36.764978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 12:57:36.764978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 12:57:36.764978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGzgE0C91kJzdWDPL8HEI1DO_KyoQf4kT7wJNcvczpLnThylRa4ipuoc-_lqDPGjXNkphI9pNXMh2Lfnj5kT_6Fi_JgameK0HJ8jgkad5Sinm82fnNPF1lbrgLYfSzxI5A1E09QwvPKEZOqov1677Fe1qlfQO9DekbFBRo76JUs1L11E Sep 09 12:57:36.764978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 12:57:36.764978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 12:57:36.764978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 12:57:36.764978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 12:57:36.764978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 12:57:36.764978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 12:57:36.764978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: 9c2a31fedb6843ba8ffea570a374acf5 Sep 09 12:57:36.764978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-DeleteServersTestJSON-1554839643 Sep 09 12:57:36.764978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 12:57:36.764978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 12:57:36.766437 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9c2a31fedb6843ba8ffea570a374acf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9c2a31fedb6843ba8ffea570a374acf5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c2a31fedb6843ba8ffea570a374acf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c2a31fedb6843ba8ffea570a374acf5"}]}] Sep 09 12:57:36.766437 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-DeleteServersTestJSON-1554839643 Sep 09 12:57:36.766437 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: 9c2a31fedb6843ba8ffea570a374acf5 Sep 09 12:57:36.766437 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-DeleteServersTestJSON-1554839643 Sep 09 12:57:36.766437 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-DeleteServersTestJSON-1554839643-project Sep 09 12:57:36.766437 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 12:57:36.766437 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 12:57:36.766437 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: c71eb53fc47c4f82add6fdd3d469230e Sep 09 12:57:36.766437 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-DeleteServersTestJSON-1554839643-project Sep 09 12:57:36.766437 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: > Sep 09 12:57:36.766437 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. Sep 09 12:57:36.766437 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'id': 'a3f10f11-bf68-4455-85ee-f551c7742ee9'} Sep 09 12:57:36.767132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:57:36.767132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:57:36.767132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:57:36.767132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:57:36.767132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:57:36.767132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:57:36.767132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:57:36.767132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:57:36.767132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:57:36.767132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:57:36.767132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. Sep 09 12:57:36.767132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:57:36.767132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:57:36.767132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:57:36.767132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:57:36.767132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:57:36.767132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:57:36.767132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:57:36.767132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:57:36.767132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:57:36.768147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:57:36.768147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:57:36.768147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:57:36.768147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:57:36.768147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:57:36.768147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:57:36.768147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:57:36.768147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. Sep 09 12:57:36.768147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:57:36.768147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:57:36.768147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:57:36.768147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:57:36.768147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:57:36.768147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:57:36.768147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:57:36.768147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:57:36.768147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. Sep 09 12:57:36.768147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:57:36.769082 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-08329111-3c35-410c-9b20-b3e5c7adc1b8 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] Returning 404 to user: Instance a3f10f11-bf68-4455-85ee-f551c7742ee9 could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:57:36.769082 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-08329111-3c35-410c-9b20-b3e5c7adc1b8 tempest-DeleteServersTestJSON-1554839643 tempest-DeleteServersTestJSON-1554839643-project] 10.222.0.46 "GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9" status: 404 len: 111 microversion: 2.1 time: 0.031650 Sep 09 12:57:36.769082 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 63/122] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:36 2022] GET /compute/v2.1/servers/a3f10f11-bf68-4455-85ee-f551c7742ee9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:57:50.100091 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=43 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:57:50.100091 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:57:50.265906 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-04e30914-c9ae-41f8-8d9e-4c036c83eded tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-8296847", "imageRef": "355bded2-2225-44b2-af86-f9e1861d05ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:57:50.330425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.network.neutron [None req-04e30914-c9ae-41f8-8d9e-4c036c83eded tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] validate_networks() for [('ac3b6ddd-d129-4d56-86ba-2ef788442f94', None, None, None, None, None)] {{(pid=127771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:57:50.723098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-04e30914-c9ae-41f8-8d9e-4c036c83eded tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Flavor limits 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:57:50.723526 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-04e30914-c9ae-41f8-8d9e-4c036c83eded tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Image limits 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:57:50.723994 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-04e30914-c9ae-41f8-8d9e-4c036c83eded tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Flavor pref 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:57:50.724399 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-04e30914-c9ae-41f8-8d9e-4c036c83eded tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Image pref 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:57:50.724807 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-04e30914-c9ae-41f8-8d9e-4c036c83eded tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:57:50.733866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-04e30914-c9ae-41f8-8d9e-4c036c83eded tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:50.734309 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-04e30914-c9ae-41f8-8d9e-4c036c83eded tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:50.734777 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-04e30914-c9ae-41f8-8d9e-4c036c83eded tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:50.735514 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-04e30914-c9ae-41f8-8d9e-4c036c83eded tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:50.736176 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-04e30914-c9ae-41f8-8d9e-4c036c83eded tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:50.736819 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-04e30914-c9ae-41f8-8d9e-4c036c83eded tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:50.753712 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-04e30914-c9ae-41f8-8d9e-4c036c83eded tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Getting quotas for project bf202f6eebd442e988e0f7307950a6c8. Resources: {'instances', 'cores', 'ram'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:57:50.758178 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-04e30914-c9ae-41f8-8d9e-4c036c83eded tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Getting quotas for user 48f14caeb8f944c6aaf27913972869c7 and project bf202f6eebd442e988e0f7307950a6c8. Resources: {'instances', 'cores', 'ram'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:57:50.769385 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-04e30914-c9ae-41f8-8d9e-4c036c83eded tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Going to run 1 instances... {{(pid=127771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:57:50.772385 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-04e30914-c9ae-41f8-8d9e-4c036c83eded tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='355bded2-2225-44b2-af86-f9e1861d05ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:57:50.900730 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-04e30914-c9ae-41f8-8d9e-4c036c83eded tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.807732 Sep 09 12:57:50.901567 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 60/123] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 12:57:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:57:50.920709 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-773b3d63-ee6b-45f1-aa5f-aee61d3a76e4 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:50.921312 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-773b3d63-ee6b-45f1-aa5f-aee61d3a76e4 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:50.923654 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:57:50.983246 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-773b3d63-ee6b-45f1-aa5f-aee61d3a76e4 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:50.999065 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-773b3d63-ee6b-45f1-aa5f-aee61d3a76e4 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1219 microversion: 2.1 time: 0.082483 Sep 09 12:57:50.999680 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 64/124] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:50 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:51.086050 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a686d443-2735-41f6-86d3-3cc0ee8ff3e3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2044679110", "imageRef": "355bded2-2225-44b2-af86-f9e1861d05ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:57:51.155437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.network.neutron [None req-a686d443-2735-41f6-86d3-3cc0ee8ff3e3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] validate_networks() for [('ac3b6ddd-d129-4d56-86ba-2ef788442f94', None, None, None, None, None)] {{(pid=127771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:57:51.788670 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-a686d443-2735-41f6-86d3-3cc0ee8ff3e3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Flavor limits 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:57:51.789128 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-a686d443-2735-41f6-86d3-3cc0ee8ff3e3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Image limits 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:57:51.789644 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-a686d443-2735-41f6-86d3-3cc0ee8ff3e3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Flavor pref 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:57:51.790083 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-a686d443-2735-41f6-86d3-3cc0ee8ff3e3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Image pref 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:57:51.790656 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-a686d443-2735-41f6-86d3-3cc0ee8ff3e3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:57:51.812883 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a686d443-2735-41f6-86d3-3cc0ee8ff3e3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:51.813372 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a686d443-2735-41f6-86d3-3cc0ee8ff3e3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:51.813849 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a686d443-2735-41f6-86d3-3cc0ee8ff3e3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:51.814619 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a686d443-2735-41f6-86d3-3cc0ee8ff3e3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:51.815164 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a686d443-2735-41f6-86d3-3cc0ee8ff3e3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:51.815599 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a686d443-2735-41f6-86d3-3cc0ee8ff3e3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:51.848273 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-a686d443-2735-41f6-86d3-3cc0ee8ff3e3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Getting quotas for project bf202f6eebd442e988e0f7307950a6c8. Resources: {'instances', 'cores', 'ram'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:57:51.853045 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-a686d443-2735-41f6-86d3-3cc0ee8ff3e3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Getting quotas for user 48f14caeb8f944c6aaf27913972869c7 and project bf202f6eebd442e988e0f7307950a6c8. Resources: {'instances', 'cores', 'ram'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:57:51.866182 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-a686d443-2735-41f6-86d3-3cc0ee8ff3e3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Going to run 1 instances... {{(pid=127771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:57:51.868190 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-a686d443-2735-41f6-86d3-3cc0ee8ff3e3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='355bded2-2225-44b2-af86-f9e1861d05ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:57:52.044660 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-a686d443-2735-41f6-86d3-3cc0ee8ff3e3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.964442 Sep 09 12:57:52.045621 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 61/125] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 12:57:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 12:57:52.058386 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-5663b08a-b8a6-4cc0-87bd-6488275c99ae tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:52.059038 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-5663b08a-b8a6-4cc0-87bd-6488275c99ae tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:52.140281 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-5663b08a-b8a6-4cc0-87bd-6488275c99ae tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:52.152693 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-5663b08a-b8a6-4cc0-87bd-6488275c99ae tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1222 microversion: 2.1 time: 0.098444 Sep 09 12:57:52.153689 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 65/126] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:52 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:53.203561 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-6df6323b-2e29-408b-82ff-7ce931a8954c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:53.206273 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-6df6323b-2e29-408b-82ff-7ce931a8954c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:53.224687 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6df6323b-2e29-408b-82ff-7ce931a8954c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:53.226824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6df6323b-2e29-408b-82ff-7ce931a8954c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:53.228696 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6df6323b-2e29-408b-82ff-7ce931a8954c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:53.232214 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6df6323b-2e29-408b-82ff-7ce931a8954c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:53.233126 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6df6323b-2e29-408b-82ff-7ce931a8954c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:53.234649 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6df6323b-2e29-408b-82ff-7ce931a8954c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:53.351740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-6df6323b-2e29-408b-82ff-7ce931a8954c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:53.372811 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-6df6323b-2e29-408b-82ff-7ce931a8954c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1226 microversion: 2.1 time: 0.199255 Sep 09 12:57:53.387503 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 62/127] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:53 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1226 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:54.412915 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-0a339457-307e-4b75-b66a-5fb39b473446 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:54.414146 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-0a339457-307e-4b75-b66a-5fb39b473446 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:54.425801 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0a339457-307e-4b75-b66a-5fb39b473446 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:54.426510 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0a339457-307e-4b75-b66a-5fb39b473446 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:54.427020 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0a339457-307e-4b75-b66a-5fb39b473446 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:54.427882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0a339457-307e-4b75-b66a-5fb39b473446 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:54.428760 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0a339457-307e-4b75-b66a-5fb39b473446 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:54.428760 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0a339457-307e-4b75-b66a-5fb39b473446 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:54.539043 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-0a339457-307e-4b75-b66a-5fb39b473446 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:54.547469 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-0a339457-307e-4b75-b66a-5fb39b473446 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1274 microversion: 2.1 time: 0.139229 Sep 09 12:57:54.547469 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 66/128] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:54 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1274 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:55.580416 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-aa6e360c-7167-430c-8ac7-676dea33a39b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:55.581788 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-aa6e360c-7167-430c-8ac7-676dea33a39b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:55.593234 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aa6e360c-7167-430c-8ac7-676dea33a39b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:55.593234 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aa6e360c-7167-430c-8ac7-676dea33a39b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:55.593234 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aa6e360c-7167-430c-8ac7-676dea33a39b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:55.593666 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aa6e360c-7167-430c-8ac7-676dea33a39b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:55.593890 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aa6e360c-7167-430c-8ac7-676dea33a39b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:55.594587 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aa6e360c-7167-430c-8ac7-676dea33a39b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:55.664258 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-aa6e360c-7167-430c-8ac7-676dea33a39b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:55.678368 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-aa6e360c-7167-430c-8ac7-676dea33a39b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1280 microversion: 2.1 time: 0.102682 Sep 09 12:57:55.678998 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 63/129] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:55 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1280 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:56.485757 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-f8f4a5b4-4758-442f-960e-e624af9c92b4 req-5fcd8ced-19a4-47e3-909c-41eac551c6fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d440fb7-9e24-433c-9cc5-282005be09bb", "tag": "1af869e9-86f9-4e43-abb7-1eb79bc433a8"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:57:56.497033 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-f8f4a5b4-4758-442f-960e-e624af9c92b4 req-5fcd8ced-19a4-47e3-909c-41eac551c6fd service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:56.498525 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-f8f4a5b4-4758-442f-960e-e624af9c92b4 req-5fcd8ced-19a4-47e3-909c-41eac551c6fd service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:56.502972 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-f8f4a5b4-4758-442f-960e-e624af9c92b4 req-5fcd8ced-19a4-47e3-909c-41eac551c6fd service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:56.525813 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-f8f4a5b4-4758-442f-960e-e624af9c92b4 req-5fcd8ced-19a4-47e3-909c-41eac551c6fd service nova] Creating event network-changed:1af869e9-86f9-4e43-abb7-1eb79bc433a8 for instance 6d440fb7-9e24-433c-9cc5-282005be09bb on hv-cinder-81322 Sep 09 12:57:56.533404 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-f8f4a5b4-4758-442f-960e-e624af9c92b4 req-5fcd8ced-19a4-47e3-909c-41eac551c6fd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050659 Sep 09 12:57:56.535992 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 67/130] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:57:56.701578 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-f093d46a-9cba-4644-9484-71c377eeb1b3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:56.703113 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-f093d46a-9cba-4644-9484-71c377eeb1b3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:56.710998 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f093d46a-9cba-4644-9484-71c377eeb1b3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:56.711672 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f093d46a-9cba-4644-9484-71c377eeb1b3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:56.712141 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f093d46a-9cba-4644-9484-71c377eeb1b3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:56.712834 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f093d46a-9cba-4644-9484-71c377eeb1b3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:56.713281 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f093d46a-9cba-4644-9484-71c377eeb1b3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:56.713763 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f093d46a-9cba-4644-9484-71c377eeb1b3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:56.901227 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-f093d46a-9cba-4644-9484-71c377eeb1b3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:56.909342 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-f093d46a-9cba-4644-9484-71c377eeb1b3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1322 microversion: 2.1 time: 0.211684 Sep 09 12:57:56.909948 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 64/131] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:56 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:57.934061 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e7e281d6-3c4c-46ea-9ff7-d3f611cf355c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:57.934929 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e7e281d6-3c4c-46ea-9ff7-d3f611cf355c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:57.960913 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e7e281d6-3c4c-46ea-9ff7-d3f611cf355c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:57.961531 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e7e281d6-3c4c-46ea-9ff7-d3f611cf355c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:57.962069 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e7e281d6-3c4c-46ea-9ff7-d3f611cf355c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:57.962803 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e7e281d6-3c4c-46ea-9ff7-d3f611cf355c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:57.963257 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e7e281d6-3c4c-46ea-9ff7-d3f611cf355c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:57.963698 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e7e281d6-3c4c-46ea-9ff7-d3f611cf355c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:58.110350 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e7e281d6-3c4c-46ea-9ff7-d3f611cf355c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:58.118438 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e7e281d6-3c4c-46ea-9ff7-d3f611cf355c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1322 microversion: 2.1 time: 0.188977 Sep 09 12:57:58.119040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 68/132] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:57 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:57:59.140744 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-9615be5a-0031-4fad-981e-fdfb3ad31a70 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:57:59.141482 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-9615be5a-0031-4fad-981e-fdfb3ad31a70 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:57:59.148638 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9615be5a-0031-4fad-981e-fdfb3ad31a70 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:59.149199 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9615be5a-0031-4fad-981e-fdfb3ad31a70 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:59.149637 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9615be5a-0031-4fad-981e-fdfb3ad31a70 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:59.150357 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9615be5a-0031-4fad-981e-fdfb3ad31a70 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:57:59.150834 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9615be5a-0031-4fad-981e-fdfb3ad31a70 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:57:59.151259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9615be5a-0031-4fad-981e-fdfb3ad31a70 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:57:59.286264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-9615be5a-0031-4fad-981e-fdfb3ad31a70 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:57:59.295630 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-9615be5a-0031-4fad-981e-fdfb3ad31a70 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1322 microversion: 2.1 time: 0.159157 Sep 09 12:57:59.296962 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 65/133] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:57:59 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:00.320274 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-18db5a7e-b1a3-4b7c-a624-e31b3e6224e9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:00.321663 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-18db5a7e-b1a3-4b7c-a624-e31b3e6224e9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:00.329538 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-18db5a7e-b1a3-4b7c-a624-e31b3e6224e9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:00.330147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-18db5a7e-b1a3-4b7c-a624-e31b3e6224e9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:00.330745 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-18db5a7e-b1a3-4b7c-a624-e31b3e6224e9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:00.331506 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-18db5a7e-b1a3-4b7c-a624-e31b3e6224e9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:00.332703 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-18db5a7e-b1a3-4b7c-a624-e31b3e6224e9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:00.333283 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-18db5a7e-b1a3-4b7c-a624-e31b3e6224e9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:00.553406 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-870b010b-c77f-40c7-a347-7c4bca78fc55 req-eb79d631-2487-4dfd-ac4d-abbe6e4caa2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfda8e07-4c29-4614-b8a1-5311ccdcf10c", "tag": "1d613b8e-332c-48d5-b684-1ecbdf6b6a45"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:58:00.577287 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-18db5a7e-b1a3-4b7c-a624-e31b3e6224e9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:00.585013 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-870b010b-c77f-40c7-a347-7c4bca78fc55 req-eb79d631-2487-4dfd-ac4d-abbe6e4caa2d service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:00.585013 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-870b010b-c77f-40c7-a347-7c4bca78fc55 req-eb79d631-2487-4dfd-ac4d-abbe6e4caa2d service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:00.585440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-870b010b-c77f-40c7-a347-7c4bca78fc55 req-eb79d631-2487-4dfd-ac4d-abbe6e4caa2d service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:00.590038 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-18db5a7e-b1a3-4b7c-a624-e31b3e6224e9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1322 microversion: 2.1 time: 0.273861 Sep 09 12:58:00.593581 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 69/134] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:00 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:00.613230 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-870b010b-c77f-40c7-a347-7c4bca78fc55 req-eb79d631-2487-4dfd-ac4d-abbe6e4caa2d service nova] Creating event network-changed:1d613b8e-332c-48d5-b684-1ecbdf6b6a45 for instance cfda8e07-4c29-4614-b8a1-5311ccdcf10c on hv-cinder-81322 Sep 09 12:58:00.622598 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-870b010b-c77f-40c7-a347-7c4bca78fc55 req-eb79d631-2487-4dfd-ac4d-abbe6e4caa2d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072529 Sep 09 12:58:00.624052 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 66/135] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:58:01.619279 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ac7f5063-c030-48f0-80b9-2ee0eb75fa69 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:01.621003 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-ac7f5063-c030-48f0-80b9-2ee0eb75fa69 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:01.627151 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ac7f5063-c030-48f0-80b9-2ee0eb75fa69 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:01.627633 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ac7f5063-c030-48f0-80b9-2ee0eb75fa69 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:01.628061 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ac7f5063-c030-48f0-80b9-2ee0eb75fa69 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:01.629520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ac7f5063-c030-48f0-80b9-2ee0eb75fa69 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:01.630077 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ac7f5063-c030-48f0-80b9-2ee0eb75fa69 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:01.630586 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ac7f5063-c030-48f0-80b9-2ee0eb75fa69 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:01.845618 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ac7f5063-c030-48f0-80b9-2ee0eb75fa69 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:01.858512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-ac7f5063-c030-48f0-80b9-2ee0eb75fa69 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1322 microversion: 2.1 time: 0.242979 Sep 09 12:58:01.860229 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 70/136] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:01 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:58:02.891408 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=4 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:58:02.892188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=12 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:58:02.896982 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-94aad40e-7e20-4312-9595-698a0a441cde tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:02.897663 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-94aad40e-7e20-4312-9595-698a0a441cde tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:02.903969 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-94aad40e-7e20-4312-9595-698a0a441cde tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:02.904460 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-94aad40e-7e20-4312-9595-698a0a441cde tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:02.904901 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-94aad40e-7e20-4312-9595-698a0a441cde tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:02.905595 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-94aad40e-7e20-4312-9595-698a0a441cde tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:02.906057 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-94aad40e-7e20-4312-9595-698a0a441cde tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:02.906509 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-94aad40e-7e20-4312-9595-698a0a441cde tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:03.049871 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-94aad40e-7e20-4312-9595-698a0a441cde tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:03.059075 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-94aad40e-7e20-4312-9595-698a0a441cde tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1322 microversion: 2.1 time: 0.169094 Sep 09 12:58:03.063785 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 67/137] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:02 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:04.081438 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-4058f24b-c949-4419-bef9-7cd3863d52f3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:04.082046 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-4058f24b-c949-4419-bef9-7cd3863d52f3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:04.084523 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=4 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:58:04.089299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4058f24b-c949-4419-bef9-7cd3863d52f3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:04.089778 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4058f24b-c949-4419-bef9-7cd3863d52f3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:04.090210 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4058f24b-c949-4419-bef9-7cd3863d52f3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:04.091041 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4058f24b-c949-4419-bef9-7cd3863d52f3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:04.091376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4058f24b-c949-4419-bef9-7cd3863d52f3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:04.091789 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4058f24b-c949-4419-bef9-7cd3863d52f3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:04.233053 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-4058f24b-c949-4419-bef9-7cd3863d52f3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:04.240839 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-4058f24b-c949-4419-bef9-7cd3863d52f3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1322 microversion: 2.1 time: 0.163574 Sep 09 12:58:04.241414 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 71/138] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:04 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:05.264635 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-249a8032-0a95-45cd-8ef7-89fa3b80a6c8 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:05.265243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-249a8032-0a95-45cd-8ef7-89fa3b80a6c8 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:05.272853 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-249a8032-0a95-45cd-8ef7-89fa3b80a6c8 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:05.273336 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-249a8032-0a95-45cd-8ef7-89fa3b80a6c8 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:05.273769 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-249a8032-0a95-45cd-8ef7-89fa3b80a6c8 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:05.274455 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-249a8032-0a95-45cd-8ef7-89fa3b80a6c8 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:05.274933 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-249a8032-0a95-45cd-8ef7-89fa3b80a6c8 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:05.275354 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-249a8032-0a95-45cd-8ef7-89fa3b80a6c8 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:05.414236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-249a8032-0a95-45cd-8ef7-89fa3b80a6c8 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:05.423196 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-249a8032-0a95-45cd-8ef7-89fa3b80a6c8 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1322 microversion: 2.1 time: 0.161945 Sep 09 12:58:05.423196 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 68/139] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:05 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:06.445461 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-3cbe5429-3802-4ba1-b582-d7df23f63c28 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:06.446033 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-3cbe5429-3802-4ba1-b582-d7df23f63c28 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:06.452694 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3cbe5429-3802-4ba1-b582-d7df23f63c28 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:06.453584 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3cbe5429-3802-4ba1-b582-d7df23f63c28 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:06.454026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3cbe5429-3802-4ba1-b582-d7df23f63c28 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:06.454747 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3cbe5429-3802-4ba1-b582-d7df23f63c28 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:06.455205 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3cbe5429-3802-4ba1-b582-d7df23f63c28 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:06.455630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3cbe5429-3802-4ba1-b582-d7df23f63c28 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:06.596510 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-3cbe5429-3802-4ba1-b582-d7df23f63c28 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:06.604674 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-3cbe5429-3802-4ba1-b582-d7df23f63c28 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1322 microversion: 2.1 time: 0.163796 Sep 09 12:58:06.605233 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 72/140] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:06 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:07.626251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8172faf5-f24c-4ac7-8f6c-52d73e02f21c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:07.626905 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-8172faf5-f24c-4ac7-8f6c-52d73e02f21c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:07.633446 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8172faf5-f24c-4ac7-8f6c-52d73e02f21c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:07.633984 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8172faf5-f24c-4ac7-8f6c-52d73e02f21c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:07.634355 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8172faf5-f24c-4ac7-8f6c-52d73e02f21c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:07.635066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8172faf5-f24c-4ac7-8f6c-52d73e02f21c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:07.635508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8172faf5-f24c-4ac7-8f6c-52d73e02f21c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:07.635918 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8172faf5-f24c-4ac7-8f6c-52d73e02f21c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:07.766556 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-8172faf5-f24c-4ac7-8f6c-52d73e02f21c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:07.775392 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-8172faf5-f24c-4ac7-8f6c-52d73e02f21c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1322 microversion: 2.1 time: 0.152875 Sep 09 12:58:07.775972 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 69/141] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:07 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:08.797810 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ff75e255-fb2f-42fd-bd70-5bf93a196983 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:08.798426 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-ff75e255-fb2f-42fd-bd70-5bf93a196983 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:08.805131 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ff75e255-fb2f-42fd-bd70-5bf93a196983 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:08.805618 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ff75e255-fb2f-42fd-bd70-5bf93a196983 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:08.806057 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ff75e255-fb2f-42fd-bd70-5bf93a196983 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:08.806778 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ff75e255-fb2f-42fd-bd70-5bf93a196983 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:08.807236 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ff75e255-fb2f-42fd-bd70-5bf93a196983 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:08.807669 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ff75e255-fb2f-42fd-bd70-5bf93a196983 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:08.936905 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ff75e255-fb2f-42fd-bd70-5bf93a196983 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:08.944662 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-ff75e255-fb2f-42fd-bd70-5bf93a196983 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1322 microversion: 2.1 time: 0.150732 Sep 09 12:58:08.945233 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 73/142] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:08 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:09.967025 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-7d436f68-87af-4fa5-a696-51422b31deb2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:09.967640 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-7d436f68-87af-4fa5-a696-51422b31deb2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:09.973953 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7d436f68-87af-4fa5-a696-51422b31deb2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:09.974438 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7d436f68-87af-4fa5-a696-51422b31deb2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:09.974905 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7d436f68-87af-4fa5-a696-51422b31deb2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:09.975591 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7d436f68-87af-4fa5-a696-51422b31deb2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:09.976043 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7d436f68-87af-4fa5-a696-51422b31deb2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:09.976469 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7d436f68-87af-4fa5-a696-51422b31deb2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:10.118842 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-7d436f68-87af-4fa5-a696-51422b31deb2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:10.130416 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-7d436f68-87af-4fa5-a696-51422b31deb2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1322 microversion: 2.1 time: 0.166337 Sep 09 12:58:10.143526 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 70/143] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:09 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:10.437618 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-7529cc09-cf6d-4aa3-8895-7d137ea23c41 req-54a529ac-3d84-4dc6-bbc1-1ecbc3f4186b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d440fb7-9e24-433c-9cc5-282005be09bb", "name": "network-vif-plugged", "status": "completed", "tag": "1af869e9-86f9-4e43-abb7-1eb79bc433a8"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:58:10.448103 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-7529cc09-cf6d-4aa3-8895-7d137ea23c41 req-54a529ac-3d84-4dc6-bbc1-1ecbc3f4186b service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:10.448736 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-7529cc09-cf6d-4aa3-8895-7d137ea23c41 req-54a529ac-3d84-4dc6-bbc1-1ecbc3f4186b service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:10.449341 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-7529cc09-cf6d-4aa3-8895-7d137ea23c41 req-54a529ac-3d84-4dc6-bbc1-1ecbc3f4186b service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:10.461971 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-7529cc09-cf6d-4aa3-8895-7d137ea23c41 req-54a529ac-3d84-4dc6-bbc1-1ecbc3f4186b service nova] Creating event network-vif-plugged:1af869e9-86f9-4e43-abb7-1eb79bc433a8 for instance 6d440fb7-9e24-433c-9cc5-282005be09bb on hv-cinder-81322 Sep 09 12:58:10.467024 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-7529cc09-cf6d-4aa3-8895-7d137ea23c41 req-54a529ac-3d84-4dc6-bbc1-1ecbc3f4186b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033070 Sep 09 12:58:10.467628 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 74/144] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:58:11.155229 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-272bc6b3-81de-4921-aceb-f197a15911f2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:11.155832 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-272bc6b3-81de-4921-aceb-f197a15911f2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:11.162219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-272bc6b3-81de-4921-aceb-f197a15911f2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:11.162791 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-272bc6b3-81de-4921-aceb-f197a15911f2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:11.163410 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-272bc6b3-81de-4921-aceb-f197a15911f2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:11.164091 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-272bc6b3-81de-4921-aceb-f197a15911f2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:11.164542 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-272bc6b3-81de-4921-aceb-f197a15911f2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:11.164960 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-272bc6b3-81de-4921-aceb-f197a15911f2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:11.302407 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-272bc6b3-81de-4921-aceb-f197a15911f2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:11.310604 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-272bc6b3-81de-4921-aceb-f197a15911f2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1322 microversion: 2.1 time: 0.159210 Sep 09 12:58:11.311157 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 71/145] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:11 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:11.335568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-178f2564-b3fd-49dd-9cbd-e0622816d309 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:11.336149 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-178f2564-b3fd-49dd-9cbd-e0622816d309 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:11.342370 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-178f2564-b3fd-49dd-9cbd-e0622816d309 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:11.342887 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-178f2564-b3fd-49dd-9cbd-e0622816d309 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:11.343325 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-178f2564-b3fd-49dd-9cbd-e0622816d309 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:11.344019 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-178f2564-b3fd-49dd-9cbd-e0622816d309 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:11.344470 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-178f2564-b3fd-49dd-9cbd-e0622816d309 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:11.344890 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-178f2564-b3fd-49dd-9cbd-e0622816d309 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:11.367961 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-178f2564-b3fd-49dd-9cbd-e0622816d309 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1/ips" status: 200 len: 151 microversion: 2.20 time: 0.037309 Sep 09 12:58:11.368520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 75/146] 10.222.0.46 () {60 vars in 1289 bytes} [Fri Sep 9 12:58:11 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:58:12.333038 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-4f9d9104-6fb9-4e93-8100-b7035518a232 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:12.333644 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-4f9d9104-6fb9-4e93-8100-b7035518a232 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:12.340002 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4f9d9104-6fb9-4e93-8100-b7035518a232 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:12.340478 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4f9d9104-6fb9-4e93-8100-b7035518a232 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:12.340910 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4f9d9104-6fb9-4e93-8100-b7035518a232 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:12.341581 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4f9d9104-6fb9-4e93-8100-b7035518a232 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:12.342024 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4f9d9104-6fb9-4e93-8100-b7035518a232 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:12.342445 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4f9d9104-6fb9-4e93-8100-b7035518a232 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:12.469051 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-4f9d9104-6fb9-4e93-8100-b7035518a232 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:12.476772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-4f9d9104-6fb9-4e93-8100-b7035518a232 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1322 microversion: 2.1 time: 0.147589 Sep 09 12:58:12.477327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 72/147] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:12 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:13.499780 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e447d364-7984-4264-8fd2-e3db680ee750 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:13.500413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e447d364-7984-4264-8fd2-e3db680ee750 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:13.506655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e447d364-7984-4264-8fd2-e3db680ee750 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:13.507149 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e447d364-7984-4264-8fd2-e3db680ee750 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:13.507585 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e447d364-7984-4264-8fd2-e3db680ee750 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:13.508285 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e447d364-7984-4264-8fd2-e3db680ee750 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:13.508744 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e447d364-7984-4264-8fd2-e3db680ee750 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:13.509171 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e447d364-7984-4264-8fd2-e3db680ee750 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:13.642003 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e447d364-7984-4264-8fd2-e3db680ee750 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:13.650244 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e447d364-7984-4264-8fd2-e3db680ee750 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1322 microversion: 2.1 time: 0.154423 Sep 09 12:58:13.650833 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 76/148] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:13 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:14.673473 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-52378e81-5e52-4da1-978c-086dfe423a3e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:14.674173 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-52378e81-5e52-4da1-978c-086dfe423a3e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:14.680830 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52378e81-5e52-4da1-978c-086dfe423a3e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:14.681323 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52378e81-5e52-4da1-978c-086dfe423a3e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:14.681762 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52378e81-5e52-4da1-978c-086dfe423a3e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:14.682607 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52378e81-5e52-4da1-978c-086dfe423a3e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:14.683138 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52378e81-5e52-4da1-978c-086dfe423a3e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:14.683568 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52378e81-5e52-4da1-978c-086dfe423a3e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:14.823683 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-52378e81-5e52-4da1-978c-086dfe423a3e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:14.831543 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-52378e81-5e52-4da1-978c-086dfe423a3e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1322 microversion: 2.1 time: 0.162225 Sep 09 12:58:14.832107 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 73/149] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:14 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:15.778059 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-b5c4971f-219c-46df-b78e-74d112693532 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:58:15.778649 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-b5c4971f-219c-46df-b78e-74d112693532 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:15.784779 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b5c4971f-219c-46df-b78e-74d112693532 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:15.785272 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b5c4971f-219c-46df-b78e-74d112693532 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:15.785748 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b5c4971f-219c-46df-b78e-74d112693532 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:15.786444 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b5c4971f-219c-46df-b78e-74d112693532 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:15.786928 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b5c4971f-219c-46df-b78e-74d112693532 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:15.788019 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b5c4971f-219c-46df-b78e-74d112693532 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:15.810325 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.objects.instance [None req-b5c4971f-219c-46df-b78e-74d112693532 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lazy-loading 'flavor' on Instance uuid 78dad9a3-ac85-4014-829c-986cca18c8b1 {{(pid=127772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:58:15.856148 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ca38df99-124c-429c-a09f-382343738b19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:15.856764 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ca38df99-124c-429c-a09f-382343738b19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:15.863259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ca38df99-124c-429c-a09f-382343738b19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:15.863746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ca38df99-124c-429c-a09f-382343738b19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:15.864180 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ca38df99-124c-429c-a09f-382343738b19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:15.864869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ca38df99-124c-429c-a09f-382343738b19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:15.865338 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ca38df99-124c-429c-a09f-382343738b19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:15.865888 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ca38df99-124c-429c-a09f-382343738b19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:15.995022 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ca38df99-124c-429c-a09f-382343738b19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:16.002839 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ca38df99-124c-429c-a09f-382343738b19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1322 microversion: 2.1 time: 0.150479 Sep 09 12:58:16.003380 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 74/150] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:15 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:58:16.370895 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-b5c4971f-219c-46df-b78e-74d112693532 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "POST /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1/action" status: 202 len: 0 microversion: 2.20 time: 0.596796 Sep 09 12:58:16.370895 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 77/151] 10.222.0.46 () {62 vars in 1319 bytes} [Fri Sep 9 12:58:15 2022] POST /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:58:16.378609 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-1563285e-6590-4ad6-b682-13e92a1d2164 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:16.379223 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-1563285e-6590-4ad6-b682-13e92a1d2164 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:16.386013 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1563285e-6590-4ad6-b682-13e92a1d2164 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:16.386517 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1563285e-6590-4ad6-b682-13e92a1d2164 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:16.386971 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1563285e-6590-4ad6-b682-13e92a1d2164 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:16.387661 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1563285e-6590-4ad6-b682-13e92a1d2164 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:16.388112 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1563285e-6590-4ad6-b682-13e92a1d2164 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:16.388535 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1563285e-6590-4ad6-b682-13e92a1d2164 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:16.519941 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-1563285e-6590-4ad6-b682-13e92a1d2164 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:16.528717 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-1563285e-6590-4ad6-b682-13e92a1d2164 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:16.530165 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-1563285e-6590-4ad6-b682-13e92a1d2164 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:16.531335 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-1563285e-6590-4ad6-b682-13e92a1d2164 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1723 microversion: 2.20 time: 0.156559 Sep 09 12:58:16.531893 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 75/152] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:16 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:17.026374 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-11789e81-e7b7-4040-bce4-27f1cabd2a2c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:17.027105 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-11789e81-e7b7-4040-bce4-27f1cabd2a2c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:17.034124 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-11789e81-e7b7-4040-bce4-27f1cabd2a2c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:17.034639 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-11789e81-e7b7-4040-bce4-27f1cabd2a2c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:17.035077 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-11789e81-e7b7-4040-bce4-27f1cabd2a2c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:17.035766 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-11789e81-e7b7-4040-bce4-27f1cabd2a2c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:17.036217 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-11789e81-e7b7-4040-bce4-27f1cabd2a2c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:17.036644 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-11789e81-e7b7-4040-bce4-27f1cabd2a2c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:17.039941 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-31dd33dd-00f4-436f-977b-0a20c9c561c2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:17.039941 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-31dd33dd-00f4-436f-977b-0a20c9c561c2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:17.045884 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31dd33dd-00f4-436f-977b-0a20c9c561c2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:17.046407 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31dd33dd-00f4-436f-977b-0a20c9c561c2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:17.046852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31dd33dd-00f4-436f-977b-0a20c9c561c2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:17.047547 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31dd33dd-00f4-436f-977b-0a20c9c561c2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:17.048004 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31dd33dd-00f4-436f-977b-0a20c9c561c2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:17.049113 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31dd33dd-00f4-436f-977b-0a20c9c561c2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:17.075025 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-31dd33dd-00f4-436f-977b-0a20c9c561c2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/ips" status: 200 len: 150 microversion: 2.1 time: 0.041926 Sep 09 12:58:17.075582 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 76/153] 10.222.0.46 () {58 vars in 1248 bytes} [Fri Sep 9 12:58:17 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:58:17.190226 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-11789e81-e7b7-4040-bce4-27f1cabd2a2c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:17.198663 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-11789e81-e7b7-4040-bce4-27f1cabd2a2c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1322 microversion: 2.1 time: 0.176528 Sep 09 12:58:17.199617 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 78/154] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:17 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:17.408237 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-b3766184-a015-4e1d-a7ef-05b1fe833f8c req-b49dac30-b2df-4978-93bd-56c230a67eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfda8e07-4c29-4614-b8a1-5311ccdcf10c", "name": "network-vif-plugged", "status": "completed", "tag": "1d613b8e-332c-48d5-b684-1ecbdf6b6a45"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:58:17.418023 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-b3766184-a015-4e1d-a7ef-05b1fe833f8c req-b49dac30-b2df-4978-93bd-56c230a67eaf service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:17.418523 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-b3766184-a015-4e1d-a7ef-05b1fe833f8c req-b49dac30-b2df-4978-93bd-56c230a67eaf service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:17.418947 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-b3766184-a015-4e1d-a7ef-05b1fe833f8c req-b49dac30-b2df-4978-93bd-56c230a67eaf service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:17.430876 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-b3766184-a015-4e1d-a7ef-05b1fe833f8c req-b49dac30-b2df-4978-93bd-56c230a67eaf service nova] Creating event network-vif-plugged:1d613b8e-332c-48d5-b684-1ecbdf6b6a45 for instance cfda8e07-4c29-4614-b8a1-5311ccdcf10c on hv-cinder-81322 Sep 09 12:58:17.435833 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-b3766184-a015-4e1d-a7ef-05b1fe833f8c req-b49dac30-b2df-4978-93bd-56c230a67eaf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031327 Sep 09 12:58:17.441478 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 77/155] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:58:17.558992 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7466f5a0-f516-46a3-beda-9ebc29e28ba2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:17.558992 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7466f5a0-f516-46a3-beda-9ebc29e28ba2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:17.563239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7466f5a0-f516-46a3-beda-9ebc29e28ba2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:17.563719 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7466f5a0-f516-46a3-beda-9ebc29e28ba2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:17.564169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7466f5a0-f516-46a3-beda-9ebc29e28ba2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:17.564895 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7466f5a0-f516-46a3-beda-9ebc29e28ba2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:17.565803 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7466f5a0-f516-46a3-beda-9ebc29e28ba2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:17.566687 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7466f5a0-f516-46a3-beda-9ebc29e28ba2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:17.707261 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7466f5a0-f516-46a3-beda-9ebc29e28ba2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:17.716734 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7466f5a0-f516-46a3-beda-9ebc29e28ba2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:17.718464 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7466f5a0-f516-46a3-beda-9ebc29e28ba2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:17.719800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7466f5a0-f516-46a3-beda-9ebc29e28ba2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1723 microversion: 2.20 time: 0.167945 Sep 09 12:58:17.720444 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 79/156] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:17 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:18.224997 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-77454281-2b59-49e6-b6c6-52542d71a04f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:18.225750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-77454281-2b59-49e6-b6c6-52542d71a04f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:18.232532 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-77454281-2b59-49e6-b6c6-52542d71a04f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:18.233287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-77454281-2b59-49e6-b6c6-52542d71a04f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:18.233637 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-77454281-2b59-49e6-b6c6-52542d71a04f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:18.234356 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-77454281-2b59-49e6-b6c6-52542d71a04f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:18.234826 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-77454281-2b59-49e6-b6c6-52542d71a04f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:18.240010 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-77454281-2b59-49e6-b6c6-52542d71a04f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:18.375905 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-77454281-2b59-49e6-b6c6-52542d71a04f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:18.383958 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-77454281-2b59-49e6-b6c6-52542d71a04f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1322 microversion: 2.1 time: 0.163198 Sep 09 12:58:18.384517 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 78/157] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:18 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:18.748156 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-01180e26-1da9-442c-b920-d64e5f85afe8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:18.748678 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-01180e26-1da9-442c-b920-d64e5f85afe8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:18.755180 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-01180e26-1da9-442c-b920-d64e5f85afe8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:18.756655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-01180e26-1da9-442c-b920-d64e5f85afe8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:18.757167 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-01180e26-1da9-442c-b920-d64e5f85afe8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:18.758628 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-01180e26-1da9-442c-b920-d64e5f85afe8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:18.759263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-01180e26-1da9-442c-b920-d64e5f85afe8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:18.760133 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-01180e26-1da9-442c-b920-d64e5f85afe8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:18.924833 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-01180e26-1da9-442c-b920-d64e5f85afe8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:18.932056 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-01180e26-1da9-442c-b920-d64e5f85afe8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:18.933542 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-01180e26-1da9-442c-b920-d64e5f85afe8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:18.934728 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-01180e26-1da9-442c-b920-d64e5f85afe8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1723 microversion: 2.20 time: 0.190558 Sep 09 12:58:18.935299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 80/158] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:18 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:19.410768 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-f8541854-81e5-49f4-9ce3-52fff1b6c733 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:19.411413 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-f8541854-81e5-49f4-9ce3-52fff1b6c733 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:19.422391 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f8541854-81e5-49f4-9ce3-52fff1b6c733 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:19.422391 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f8541854-81e5-49f4-9ce3-52fff1b6c733 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:19.422391 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f8541854-81e5-49f4-9ce3-52fff1b6c733 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:19.422391 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f8541854-81e5-49f4-9ce3-52fff1b6c733 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:19.422897 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f8541854-81e5-49f4-9ce3-52fff1b6c733 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:19.422897 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f8541854-81e5-49f4-9ce3-52fff1b6c733 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:19.443358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=100 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:58:19.570721 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-f8541854-81e5-49f4-9ce3-52fff1b6c733 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:19.578698 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-f8541854-81e5-49f4-9ce3-52fff1b6c733 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1322 microversion: 2.1 time: 0.171766 Sep 09 12:58:19.580035 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 79/159] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:19 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:19.964831 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-2b90d49c-ba68-42ae-8893-5bd2fd312a4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:19.965524 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-2b90d49c-ba68-42ae-8893-5bd2fd312a4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:19.971547 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2b90d49c-ba68-42ae-8893-5bd2fd312a4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:19.972028 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2b90d49c-ba68-42ae-8893-5bd2fd312a4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:19.972462 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2b90d49c-ba68-42ae-8893-5bd2fd312a4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:19.973155 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2b90d49c-ba68-42ae-8893-5bd2fd312a4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:19.973611 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2b90d49c-ba68-42ae-8893-5bd2fd312a4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:19.974119 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2b90d49c-ba68-42ae-8893-5bd2fd312a4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:20.123889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-2b90d49c-ba68-42ae-8893-5bd2fd312a4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:20.133089 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-2b90d49c-ba68-42ae-8893-5bd2fd312a4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:20.135247 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-2b90d49c-ba68-42ae-8893-5bd2fd312a4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:20.136427 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-2b90d49c-ba68-42ae-8893-5bd2fd312a4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1723 microversion: 2.20 time: 0.176754 Sep 09 12:58:20.136990 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 81/160] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:19 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:20.290977 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-c605d74f-5104-4deb-b7f5-a4f630b0a5d1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab711164-1a6a-4f8f-b353-5b028bbcb8da"}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:58:20.304120 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-c605d74f-5104-4deb-b7f5-a4f630b0a5d1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:20.312463 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c605d74f-5104-4deb-b7f5-a4f630b0a5d1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:20.313005 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c605d74f-5104-4deb-b7f5-a4f630b0a5d1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:20.313744 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c605d74f-5104-4deb-b7f5-a4f630b0a5d1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:20.314820 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c605d74f-5104-4deb-b7f5-a4f630b0a5d1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:20.315315 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c605d74f-5104-4deb-b7f5-a4f630b0a5d1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:20.315798 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c605d74f-5104-4deb-b7f5-a4f630b0a5d1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:20.602841 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7a2f5b3b-b3b5-43f6-9339-9fab899635e8 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:20.603397 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7a2f5b3b-b3b5-43f6-9339-9fab899635e8 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:20.609239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a2f5b3b-b3b5-43f6-9339-9fab899635e8 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:20.609787 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a2f5b3b-b3b5-43f6-9339-9fab899635e8 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:20.610220 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a2f5b3b-b3b5-43f6-9339-9fab899635e8 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:20.610928 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a2f5b3b-b3b5-43f6-9339-9fab899635e8 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:20.611380 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a2f5b3b-b3b5-43f6-9339-9fab899635e8 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:20.611802 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a2f5b3b-b3b5-43f6-9339-9fab899635e8 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:20.615798 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:58:20.744681 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7a2f5b3b-b3b5-43f6-9339-9fab899635e8 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:20.753271 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7a2f5b3b-b3b5-43f6-9339-9fab899635e8 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1516 microversion: 2.1 time: 0.154953 Sep 09 12:58:20.753846 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 82/161] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:20 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:58:20.775182 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-90869ad2-6a09-4919-96ac-356345d1b8c2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:58:20.780537 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-90869ad2-6a09-4919-96ac-356345d1b8c2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:20.783313 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-90869ad2-6a09-4919-96ac-356345d1b8c2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:20.783794 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-90869ad2-6a09-4919-96ac-356345d1b8c2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:20.784233 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-90869ad2-6a09-4919-96ac-356345d1b8c2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:20.784912 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-90869ad2-6a09-4919-96ac-356345d1b8c2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:20.785362 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-90869ad2-6a09-4919-96ac-356345d1b8c2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:20.785777 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-90869ad2-6a09-4919-96ac-356345d1b8c2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:20.810020 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.objects.instance [None req-90869ad2-6a09-4919-96ac-356345d1b8c2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lazy-loading 'flavor' on Instance uuid cfda8e07-4c29-4614-b8a1-5311ccdcf10c {{(pid=127772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:58:21.246223 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-90869ad2-6a09-4919-96ac-356345d1b8c2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "POST /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c/action" status: 200 len: 32 microversion: 2.1 time: 0.474950 Sep 09 12:58:21.249641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 83/162] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 12:58:20 2022] POST /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c/action => generated 32 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 12:58:21.255415 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-06111f43-e58e-43df-a261-dbc9a29521a0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:21.256105 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-06111f43-e58e-43df-a261-dbc9a29521a0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:21.263451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-06111f43-e58e-43df-a261-dbc9a29521a0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:21.264115 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-06111f43-e58e-43df-a261-dbc9a29521a0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:21.264966 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-06111f43-e58e-43df-a261-dbc9a29521a0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:21.265836 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-06111f43-e58e-43df-a261-dbc9a29521a0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:21.266497 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-06111f43-e58e-43df-a261-dbc9a29521a0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:21.267111 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-06111f43-e58e-43df-a261-dbc9a29521a0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:21.408282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-06111f43-e58e-43df-a261-dbc9a29521a0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:21.417899 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-06111f43-e58e-43df-a261-dbc9a29521a0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:21.419368 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-06111f43-e58e-43df-a261-dbc9a29521a0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:21.420681 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-06111f43-e58e-43df-a261-dbc9a29521a0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1723 microversion: 2.20 time: 0.169661 Sep 09 12:58:21.421272 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 84/163] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:21 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:21.429493 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-4d1273c4-803f-4386-8609-23a271c49ab1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:21.430045 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-4d1273c4-803f-4386-8609-23a271c49ab1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:21.441305 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d1273c4-803f-4386-8609-23a271c49ab1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:21.441845 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d1273c4-803f-4386-8609-23a271c49ab1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:21.442287 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d1273c4-803f-4386-8609-23a271c49ab1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:21.443030 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d1273c4-803f-4386-8609-23a271c49ab1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:21.443661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d1273c4-803f-4386-8609-23a271c49ab1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:21.444088 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d1273c4-803f-4386-8609-23a271c49ab1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:21.738922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-c605d74f-5104-4deb-b7f5-a4f630b0a5d1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "POST /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.455608 Sep 09 12:58:21.741528 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 80/164] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 12:58:20 2022] POST /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments => generated 194 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:58:21.913912 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-4d1273c4-803f-4386-8609-23a271c49ab1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:21.922567 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-4d1273c4-803f-4386-8609-23a271c49ab1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.500022 Sep 09 12:58:21.923148 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 85/165] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:21 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:22.448416 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-fa0e0246-0421-4192-99fb-4061e17979b2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:22.449102 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-fa0e0246-0421-4192-99fb-4061e17979b2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:22.466143 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:58:22.469707 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fa0e0246-0421-4192-99fb-4061e17979b2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:22.470360 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fa0e0246-0421-4192-99fb-4061e17979b2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:22.470844 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fa0e0246-0421-4192-99fb-4061e17979b2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:22.471659 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fa0e0246-0421-4192-99fb-4061e17979b2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:22.472119 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fa0e0246-0421-4192-99fb-4061e17979b2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:22.472561 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fa0e0246-0421-4192-99fb-4061e17979b2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:22.621137 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-fa0e0246-0421-4192-99fb-4061e17979b2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:22.631262 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-fa0e0246-0421-4192-99fb-4061e17979b2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:22.631757 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-fa0e0246-0421-4192-99fb-4061e17979b2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:22.632988 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-fa0e0246-0421-4192-99fb-4061e17979b2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1723 microversion: 2.20 time: 0.189690 Sep 09 12:58:22.633504 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 81/166] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:22 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:22.948541 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-385b7803-0034-447d-9106-51ed2cad24d0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:22.950726 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-385b7803-0034-447d-9106-51ed2cad24d0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:22.954709 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=50 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:58:22.961208 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-385b7803-0034-447d-9106-51ed2cad24d0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:22.965130 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-385b7803-0034-447d-9106-51ed2cad24d0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:22.965130 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-385b7803-0034-447d-9106-51ed2cad24d0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:22.965130 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-385b7803-0034-447d-9106-51ed2cad24d0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:22.965130 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-385b7803-0034-447d-9106-51ed2cad24d0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:22.965917 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-385b7803-0034-447d-9106-51ed2cad24d0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:23.137799 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-385b7803-0034-447d-9106-51ed2cad24d0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:23.145316 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-385b7803-0034-447d-9106-51ed2cad24d0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.203871 Sep 09 12:58:23.145872 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 86/167] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:22 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:23.661291 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-cebb08ea-4006-45a5-b757-ad661c2e3e90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:23.662006 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-cebb08ea-4006-45a5-b757-ad661c2e3e90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:23.669244 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cebb08ea-4006-45a5-b757-ad661c2e3e90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:23.669679 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cebb08ea-4006-45a5-b757-ad661c2e3e90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:23.670117 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cebb08ea-4006-45a5-b757-ad661c2e3e90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:23.670836 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cebb08ea-4006-45a5-b757-ad661c2e3e90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:23.671322 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cebb08ea-4006-45a5-b757-ad661c2e3e90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:23.671747 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cebb08ea-4006-45a5-b757-ad661c2e3e90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:23.816098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-cebb08ea-4006-45a5-b757-ad661c2e3e90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:23.825658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-cebb08ea-4006-45a5-b757-ad661c2e3e90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:23.827155 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-cebb08ea-4006-45a5-b757-ad661c2e3e90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:23.828578 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-cebb08ea-4006-45a5-b757-ad661c2e3e90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1723 microversion: 2.20 time: 0.172757 Sep 09 12:58:23.829138 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 82/168] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:23 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:24.169247 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7e114322-04fa-4105-b93a-7fc4bce32412 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:24.169957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7e114322-04fa-4105-b93a-7fc4bce32412 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:24.176673 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7e114322-04fa-4105-b93a-7fc4bce32412 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:24.177089 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7e114322-04fa-4105-b93a-7fc4bce32412 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:24.177531 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7e114322-04fa-4105-b93a-7fc4bce32412 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:24.178241 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7e114322-04fa-4105-b93a-7fc4bce32412 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:24.178731 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7e114322-04fa-4105-b93a-7fc4bce32412 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:24.179163 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7e114322-04fa-4105-b93a-7fc4bce32412 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:24.313243 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7e114322-04fa-4105-b93a-7fc4bce32412 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:24.321657 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7e114322-04fa-4105-b93a-7fc4bce32412 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.155963 Sep 09 12:58:24.322374 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 87/169] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:24 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:24.853440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a41ac34e-b95d-49ca-a605-de5db95a17ef tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:24.855782 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-a41ac34e-b95d-49ca-a605-de5db95a17ef tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:24.862192 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a41ac34e-b95d-49ca-a605-de5db95a17ef tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:24.862720 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a41ac34e-b95d-49ca-a605-de5db95a17ef tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:24.863157 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a41ac34e-b95d-49ca-a605-de5db95a17ef tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:24.863870 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a41ac34e-b95d-49ca-a605-de5db95a17ef tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:24.864317 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a41ac34e-b95d-49ca-a605-de5db95a17ef tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:24.864738 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a41ac34e-b95d-49ca-a605-de5db95a17ef tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:24.994229 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-a41ac34e-b95d-49ca-a605-de5db95a17ef tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:25.002271 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-a41ac34e-b95d-49ca-a605-de5db95a17ef tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:25.003764 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-a41ac34e-b95d-49ca-a605-de5db95a17ef tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:25.004904 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-a41ac34e-b95d-49ca-a605-de5db95a17ef tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1723 microversion: 2.20 time: 0.155707 Sep 09 12:58:25.005454 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 83/170] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:24 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:25.345249 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a184a959-fe0a-4b03-ba86-0924312b1b72 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:25.345807 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a184a959-fe0a-4b03-ba86-0924312b1b72 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:25.352031 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a184a959-fe0a-4b03-ba86-0924312b1b72 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:25.353245 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a184a959-fe0a-4b03-ba86-0924312b1b72 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:25.353761 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a184a959-fe0a-4b03-ba86-0924312b1b72 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:25.354445 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a184a959-fe0a-4b03-ba86-0924312b1b72 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:25.354917 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a184a959-fe0a-4b03-ba86-0924312b1b72 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:25.355337 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a184a959-fe0a-4b03-ba86-0924312b1b72 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:25.488279 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a184a959-fe0a-4b03-ba86-0924312b1b72 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:25.494217 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a184a959-fe0a-4b03-ba86-0924312b1b72 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.152940 Sep 09 12:58:25.494825 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 88/171] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:25 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:26.031270 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e2065cc2-1113-4005-a096-f9f3d88db686 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:26.031872 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-e2065cc2-1113-4005-a096-f9f3d88db686 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:26.039288 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e2065cc2-1113-4005-a096-f9f3d88db686 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:26.040529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e2065cc2-1113-4005-a096-f9f3d88db686 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:26.041258 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e2065cc2-1113-4005-a096-f9f3d88db686 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:26.042527 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e2065cc2-1113-4005-a096-f9f3d88db686 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:26.042999 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e2065cc2-1113-4005-a096-f9f3d88db686 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:26.043502 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e2065cc2-1113-4005-a096-f9f3d88db686 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:26.195586 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e2065cc2-1113-4005-a096-f9f3d88db686 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:26.205049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e2065cc2-1113-4005-a096-f9f3d88db686 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:26.209545 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e2065cc2-1113-4005-a096-f9f3d88db686 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:26.209545 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-e2065cc2-1113-4005-a096-f9f3d88db686 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1723 microversion: 2.20 time: 0.180535 Sep 09 12:58:26.209545 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 84/172] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:26 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:26.516252 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-319913e1-3963-4003-9e1b-03aa63143321 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:26.516997 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-319913e1-3963-4003-9e1b-03aa63143321 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:26.523148 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-319913e1-3963-4003-9e1b-03aa63143321 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:26.523630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-319913e1-3963-4003-9e1b-03aa63143321 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:26.524584 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-319913e1-3963-4003-9e1b-03aa63143321 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:26.525730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-319913e1-3963-4003-9e1b-03aa63143321 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:26.526568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-319913e1-3963-4003-9e1b-03aa63143321 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:26.527176 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-319913e1-3963-4003-9e1b-03aa63143321 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:26.680172 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-319913e1-3963-4003-9e1b-03aa63143321 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:26.690291 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-319913e1-3963-4003-9e1b-03aa63143321 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.177741 Sep 09 12:58:26.691156 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 89/173] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:26 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:27.243869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-31445367-77f6-4205-90fc-c43c6812af4f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:27.244579 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-31445367-77f6-4205-90fc-c43c6812af4f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:27.252120 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31445367-77f6-4205-90fc-c43c6812af4f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:27.252603 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31445367-77f6-4205-90fc-c43c6812af4f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:27.253034 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31445367-77f6-4205-90fc-c43c6812af4f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:27.253758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31445367-77f6-4205-90fc-c43c6812af4f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:27.254205 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31445367-77f6-4205-90fc-c43c6812af4f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:27.254661 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31445367-77f6-4205-90fc-c43c6812af4f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:27.394868 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-31445367-77f6-4205-90fc-c43c6812af4f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:27.404659 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-31445367-77f6-4205-90fc-c43c6812af4f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:27.405309 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-31445367-77f6-4205-90fc-c43c6812af4f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:27.406442 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-31445367-77f6-4205-90fc-c43c6812af4f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1723 microversion: 2.20 time: 0.166985 Sep 09 12:58:27.407013 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 85/174] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:27 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:27.716880 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a0e7897c-d106-42b5-b242-988cecd86bf2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:27.718059 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a0e7897c-d106-42b5-b242-988cecd86bf2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:27.724335 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a0e7897c-d106-42b5-b242-988cecd86bf2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:27.727865 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a0e7897c-d106-42b5-b242-988cecd86bf2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:27.727865 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a0e7897c-d106-42b5-b242-988cecd86bf2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:27.727865 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a0e7897c-d106-42b5-b242-988cecd86bf2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:27.727865 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a0e7897c-d106-42b5-b242-988cecd86bf2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:27.728201 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a0e7897c-d106-42b5-b242-988cecd86bf2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:27.874580 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a0e7897c-d106-42b5-b242-988cecd86bf2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:27.882368 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a0e7897c-d106-42b5-b242-988cecd86bf2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.169609 Sep 09 12:58:27.883012 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 90/175] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:27 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:28.447689 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e80e14b0-66be-4fbd-b003-7f4cf71031e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:28.447689 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-e80e14b0-66be-4fbd-b003-7f4cf71031e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:28.448802 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e80e14b0-66be-4fbd-b003-7f4cf71031e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:28.449394 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e80e14b0-66be-4fbd-b003-7f4cf71031e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:28.449830 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e80e14b0-66be-4fbd-b003-7f4cf71031e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:28.450549 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e80e14b0-66be-4fbd-b003-7f4cf71031e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:28.451005 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e80e14b0-66be-4fbd-b003-7f4cf71031e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:28.451429 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e80e14b0-66be-4fbd-b003-7f4cf71031e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:28.596074 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e80e14b0-66be-4fbd-b003-7f4cf71031e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:28.604618 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e80e14b0-66be-4fbd-b003-7f4cf71031e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:28.606189 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e80e14b0-66be-4fbd-b003-7f4cf71031e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:28.607381 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-e80e14b0-66be-4fbd-b003-7f4cf71031e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1723 microversion: 2.20 time: 0.170097 Sep 09 12:58:28.607937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 86/176] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:28 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:28.905514 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-8c2e3443-aead-4787-83eb-dc57d8e8d062 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:28.906519 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-8c2e3443-aead-4787-83eb-dc57d8e8d062 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:28.912417 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8c2e3443-aead-4787-83eb-dc57d8e8d062 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:28.912899 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8c2e3443-aead-4787-83eb-dc57d8e8d062 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:28.913329 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8c2e3443-aead-4787-83eb-dc57d8e8d062 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:28.914059 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8c2e3443-aead-4787-83eb-dc57d8e8d062 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:28.914546 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8c2e3443-aead-4787-83eb-dc57d8e8d062 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:28.915631 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8c2e3443-aead-4787-83eb-dc57d8e8d062 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:29.084032 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-8c2e3443-aead-4787-83eb-dc57d8e8d062 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:29.094000 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-8c2e3443-aead-4787-83eb-dc57d8e8d062 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.192650 Sep 09 12:58:29.095338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 91/177] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:28 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:29.511889 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-db055b8e-4f38-477b-be6e-18442067a464 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Action: 'create', calling method: .version_select at 0x7f3183333ca0>, body: {"keypair": {"name": "tempest-keypair-1701927809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcN4OfhSExq56+oKaIS45GhMw6VDXh1du30Nt+xD33ouM1M1V4CCFKqudYmDv4OevRwad1lYtv2gCznwo4H9ryJDzjeQP6UcXYiKsxnR7dIzvubua9oGetYevFvbCfjNw=="}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:58:29.532745 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-db055b8e-4f38-477b-be6e-18442067a464 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Getting quotas for project ceed6a1f0f4542cbafa4b2a46b16d5fb. Resources: {'key_pairs'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:58:29.536756 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-db055b8e-4f38-477b-be6e-18442067a464 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Getting quotas for user 63a2902f465f4fd1aed80060c2669259 and project ceed6a1f0f4542cbafa4b2a46b16d5fb. Resources: {'key_pairs'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:58:29.633250 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-9514c88e-6b4a-4334-9749-02e6d277070e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:29.633866 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-9514c88e-6b4a-4334-9749-02e6d277070e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:29.640782 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9514c88e-6b4a-4334-9749-02e6d277070e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:29.641278 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9514c88e-6b4a-4334-9749-02e6d277070e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:29.641915 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9514c88e-6b4a-4334-9749-02e6d277070e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:29.642663 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9514c88e-6b4a-4334-9749-02e6d277070e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:29.643286 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9514c88e-6b4a-4334-9749-02e6d277070e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:29.643881 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9514c88e-6b4a-4334-9749-02e6d277070e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:29.655004 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-db055b8e-4f38-477b-be6e-18442067a464 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.147472 Sep 09 12:58:29.656200 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 87/178] 10.222.0.46 () {60 vars in 1159 bytes} [Fri Sep 9 12:58:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:58:29.793717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-9514c88e-6b4a-4334-9749-02e6d277070e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:29.801740 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-9514c88e-6b4a-4334-9749-02e6d277070e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:29.803230 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-9514c88e-6b4a-4334-9749-02e6d277070e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:29.804392 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-9514c88e-6b4a-4334-9749-02e6d277070e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1723 microversion: 2.20 time: 0.175039 Sep 09 12:58:29.805499 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 92/179] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:29 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:58:30.120316 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-f536700e-97c8-4eea-ad1f-cbf9739bb640 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:30.121333 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-f536700e-97c8-4eea-ad1f-cbf9739bb640 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:30.131075 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f536700e-97c8-4eea-ad1f-cbf9739bb640 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:30.131688 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f536700e-97c8-4eea-ad1f-cbf9739bb640 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:30.132308 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f536700e-97c8-4eea-ad1f-cbf9739bb640 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:30.133140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f536700e-97c8-4eea-ad1f-cbf9739bb640 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:30.134035 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f536700e-97c8-4eea-ad1f-cbf9739bb640 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:30.134606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f536700e-97c8-4eea-ad1f-cbf9739bb640 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:30.320720 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-f536700e-97c8-4eea-ad1f-cbf9739bb640 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:30.332039 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-f536700e-97c8-4eea-ad1f-cbf9739bb640 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.216541 Sep 09 12:58:30.333088 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 88/180] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:30 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:30.833624 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-f243d2f9-caf7-459e-9a8b-b61e4d331cea tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:30.834234 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-f243d2f9-caf7-459e-9a8b-b61e4d331cea tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:30.840784 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f243d2f9-caf7-459e-9a8b-b61e4d331cea tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:30.841279 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f243d2f9-caf7-459e-9a8b-b61e4d331cea tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:30.841711 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f243d2f9-caf7-459e-9a8b-b61e4d331cea tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:30.842642 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f243d2f9-caf7-459e-9a8b-b61e4d331cea tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:30.843287 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f243d2f9-caf7-459e-9a8b-b61e4d331cea tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:30.843704 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f243d2f9-caf7-459e-9a8b-b61e4d331cea tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:31.001781 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-f243d2f9-caf7-459e-9a8b-b61e4d331cea tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:31.011424 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-f243d2f9-caf7-459e-9a8b-b61e4d331cea tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:31.012886 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-f243d2f9-caf7-459e-9a8b-b61e4d331cea tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:31.014035 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-f243d2f9-caf7-459e-9a8b-b61e4d331cea tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1723 microversion: 2.20 time: 0.184386 Sep 09 12:58:31.014760 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 93/181] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:30 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:31.357110 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-9560387e-20e3-45d1-874f-f887242c5a2b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:31.358561 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-9560387e-20e3-45d1-874f-f887242c5a2b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:31.365374 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9560387e-20e3-45d1-874f-f887242c5a2b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:31.365942 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9560387e-20e3-45d1-874f-f887242c5a2b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:31.366646 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9560387e-20e3-45d1-874f-f887242c5a2b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:31.367521 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9560387e-20e3-45d1-874f-f887242c5a2b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:31.368098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9560387e-20e3-45d1-874f-f887242c5a2b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:31.368685 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9560387e-20e3-45d1-874f-f887242c5a2b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:31.553575 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-9560387e-20e3-45d1-874f-f887242c5a2b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:31.563133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-9560387e-20e3-45d1-874f-f887242c5a2b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.210624 Sep 09 12:58:31.575030 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 89/182] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:31 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:32.041748 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-9b013d6c-e2f4-4d71-9d80-afcc5954a4f8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:32.043324 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-9b013d6c-e2f4-4d71-9d80-afcc5954a4f8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:32.049782 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9b013d6c-e2f4-4d71-9d80-afcc5954a4f8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:32.050362 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9b013d6c-e2f4-4d71-9d80-afcc5954a4f8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:32.051340 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9b013d6c-e2f4-4d71-9d80-afcc5954a4f8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:32.052089 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9b013d6c-e2f4-4d71-9d80-afcc5954a4f8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:32.052541 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9b013d6c-e2f4-4d71-9d80-afcc5954a4f8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:32.053153 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9b013d6c-e2f4-4d71-9d80-afcc5954a4f8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:32.199062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-9b013d6c-e2f4-4d71-9d80-afcc5954a4f8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:32.210731 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-9b013d6c-e2f4-4d71-9d80-afcc5954a4f8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:32.210731 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-9b013d6c-e2f4-4d71-9d80-afcc5954a4f8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:32.211095 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-9b013d6c-e2f4-4d71-9d80-afcc5954a4f8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1723 microversion: 2.20 time: 0.174766 Sep 09 12:58:32.211644 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 94/183] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:32 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:32.327795 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d0b89074-e7f1-4621-a16d-a2a018ceb8af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1407553757", "imageRef": "355bded2-2225-44b2-af86-f9e1861d05ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4f411e2-e42e-4ab3-86d3-b0b098a1a8fe"}], "security_groups": [{"name": "tempest-securitygroup--2025744482"}], "key_name": "tempest-keypair-1701927809", "user_data": "}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:58:32.438845 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.network.neutron [None req-d0b89074-e7f1-4621-a16d-a2a018ceb8af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] validate_networks() for [('c4f411e2-e42e-4ab3-86d3-b0b098a1a8fe', None, None, None, None, None)] {{(pid=127771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:58:32.587351 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-4940417a-ebb0-4208-b6e7-928556cd29cf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:32.588038 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-4940417a-ebb0-4208-b6e7-928556cd29cf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:32.594234 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4940417a-ebb0-4208-b6e7-928556cd29cf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:32.595744 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4940417a-ebb0-4208-b6e7-928556cd29cf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:32.596398 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4940417a-ebb0-4208-b6e7-928556cd29cf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:32.597176 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4940417a-ebb0-4208-b6e7-928556cd29cf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:32.597709 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4940417a-ebb0-4208-b6e7-928556cd29cf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:32.598291 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4940417a-ebb0-4208-b6e7-928556cd29cf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:32.771516 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-4940417a-ebb0-4208-b6e7-928556cd29cf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:32.780299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-4940417a-ebb0-4208-b6e7-928556cd29cf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.196737 Sep 09 12:58:32.780869 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 95/184] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:32 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:58:32.823822 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-d0b89074-e7f1-4621-a16d-a2a018ceb8af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Flavor limits 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:58:32.824245 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-d0b89074-e7f1-4621-a16d-a2a018ceb8af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Image limits 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:58:32.824716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-d0b89074-e7f1-4621-a16d-a2a018ceb8af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Flavor pref 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:58:32.825159 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-d0b89074-e7f1-4621-a16d-a2a018ceb8af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Image pref 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:58:32.825654 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-d0b89074-e7f1-4621-a16d-a2a018ceb8af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:58:32.834978 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d0b89074-e7f1-4621-a16d-a2a018ceb8af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:32.835478 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d0b89074-e7f1-4621-a16d-a2a018ceb8af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:32.835906 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d0b89074-e7f1-4621-a16d-a2a018ceb8af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:32.837689 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d0b89074-e7f1-4621-a16d-a2a018ceb8af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:32.837689 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d0b89074-e7f1-4621-a16d-a2a018ceb8af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:32.837689 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d0b89074-e7f1-4621-a16d-a2a018ceb8af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:32.855039 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-d0b89074-e7f1-4621-a16d-a2a018ceb8af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Getting quotas for project ceed6a1f0f4542cbafa4b2a46b16d5fb. Resources: {'instances', 'cores', 'ram'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:58:32.859250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-d0b89074-e7f1-4621-a16d-a2a018ceb8af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Getting quotas for user 63a2902f465f4fd1aed80060c2669259 and project ceed6a1f0f4542cbafa4b2a46b16d5fb. Resources: {'instances', 'cores', 'ram'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:58:32.871470 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-d0b89074-e7f1-4621-a16d-a2a018ceb8af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Going to run 1 instances... {{(pid=127771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:58:32.873770 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-d0b89074-e7f1-4621-a16d-a2a018ceb8af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='355bded2-2225-44b2-af86-f9e1861d05ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:58:33.059313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d0b89074-e7f1-4621-a16d-a2a018ceb8af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.736038 Sep 09 12:58:33.060309 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 90/185] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 12:58:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:58:33.071817 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-9db30412-fc7a-4fb2-850f-74e55935df4d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:33.072629 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-9db30412-fc7a-4fb2-850f-74e55935df4d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:33.196890 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-9db30412-fc7a-4fb2-850f-74e55935df4d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:33.218906 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-9db30412-fc7a-4fb2-850f-74e55935df4d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1242 microversion: 2.1 time: 0.151091 Sep 09 12:58:33.219571 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 96/186] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:33 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1242 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:33.250455 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2b917665-5ae1-4a2c-a0b4-019deb6b6070 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:33.250455 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2b917665-5ae1-4a2c-a0b4-019deb6b6070 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:33.250455 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2b917665-5ae1-4a2c-a0b4-019deb6b6070 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:33.250455 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2b917665-5ae1-4a2c-a0b4-019deb6b6070 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:33.250787 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2b917665-5ae1-4a2c-a0b4-019deb6b6070 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:33.250787 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2b917665-5ae1-4a2c-a0b4-019deb6b6070 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:33.251548 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2b917665-5ae1-4a2c-a0b4-019deb6b6070 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:33.252197 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2b917665-5ae1-4a2c-a0b4-019deb6b6070 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:33.402784 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2b917665-5ae1-4a2c-a0b4-019deb6b6070 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:33.422525 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2b917665-5ae1-4a2c-a0b4-019deb6b6070 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:33.423969 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2b917665-5ae1-4a2c-a0b4-019deb6b6070 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:33.425146 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2b917665-5ae1-4a2c-a0b4-019deb6b6070 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1723 microversion: 2.20 time: 0.190119 Sep 09 12:58:33.430520 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 91/187] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:33 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:33.804184 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-4a5c335e-41c6-4260-b729-62ba35e592b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:33.804937 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-4a5c335e-41c6-4260-b729-62ba35e592b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:33.811070 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4a5c335e-41c6-4260-b729-62ba35e592b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:33.811552 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4a5c335e-41c6-4260-b729-62ba35e592b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:33.811986 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4a5c335e-41c6-4260-b729-62ba35e592b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:33.812675 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4a5c335e-41c6-4260-b729-62ba35e592b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:33.813124 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4a5c335e-41c6-4260-b729-62ba35e592b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:33.813550 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4a5c335e-41c6-4260-b729-62ba35e592b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:33.949503 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-4a5c335e-41c6-4260-b729-62ba35e592b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:33.952918 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:58:33.959671 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-4a5c335e-41c6-4260-b729-62ba35e592b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.159639 Sep 09 12:58:33.960252 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 97/188] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:33 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:34.245664 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-f83c61e8-b772-457f-be04-5c6a6395e6b8 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:34.248432 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-f83c61e8-b772-457f-be04-5c6a6395e6b8 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:34.267786 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f83c61e8-b772-457f-be04-5c6a6395e6b8 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:34.272266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f83c61e8-b772-457f-be04-5c6a6395e6b8 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:34.272266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f83c61e8-b772-457f-be04-5c6a6395e6b8 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:34.272951 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f83c61e8-b772-457f-be04-5c6a6395e6b8 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:34.273080 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f83c61e8-b772-457f-be04-5c6a6395e6b8 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:34.274756 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f83c61e8-b772-457f-be04-5c6a6395e6b8 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:34.341363 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-f83c61e8-b772-457f-be04-5c6a6395e6b8 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:34.349412 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-f83c61e8-b772-457f-be04-5c6a6395e6b8 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1246 microversion: 2.1 time: 0.109501 Sep 09 12:58:34.350350 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 92/189] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:34 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1246 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:34.456159 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-5991debb-497d-494e-bdc8-9bf0b162e994 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:34.456159 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-5991debb-497d-494e-bdc8-9bf0b162e994 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:34.459725 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5991debb-497d-494e-bdc8-9bf0b162e994 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:34.460458 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5991debb-497d-494e-bdc8-9bf0b162e994 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:34.461108 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5991debb-497d-494e-bdc8-9bf0b162e994 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:34.462039 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5991debb-497d-494e-bdc8-9bf0b162e994 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:34.463369 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5991debb-497d-494e-bdc8-9bf0b162e994 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:34.464037 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5991debb-497d-494e-bdc8-9bf0b162e994 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:34.753149 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-5991debb-497d-494e-bdc8-9bf0b162e994 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:34.772608 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-5991debb-497d-494e-bdc8-9bf0b162e994 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:34.782424 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-5991debb-497d-494e-bdc8-9bf0b162e994 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:34.783406 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-5991debb-497d-494e-bdc8-9bf0b162e994 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1744 microversion: 2.20 time: 0.335982 Sep 09 12:58:34.785818 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 98/190] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:34 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1744 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:34.990984 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a66d4f1b-fb7e-421a-9d4e-538d7fcea813 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:34.991604 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-a66d4f1b-fb7e-421a-9d4e-538d7fcea813 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:34.998420 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a66d4f1b-fb7e-421a-9d4e-538d7fcea813 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:34.999122 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a66d4f1b-fb7e-421a-9d4e-538d7fcea813 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:34.999735 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a66d4f1b-fb7e-421a-9d4e-538d7fcea813 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:35.000780 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a66d4f1b-fb7e-421a-9d4e-538d7fcea813 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:35.001528 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a66d4f1b-fb7e-421a-9d4e-538d7fcea813 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:35.002124 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a66d4f1b-fb7e-421a-9d4e-538d7fcea813 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:35.214539 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-a66d4f1b-fb7e-421a-9d4e-538d7fcea813 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:35.221458 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-a66d4f1b-fb7e-421a-9d4e-538d7fcea813 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.238489 Sep 09 12:58:35.222095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 93/191] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:34 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:35.374189 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-120f73e3-1db4-458b-b6ce-81599b70c3b6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:35.374836 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-120f73e3-1db4-458b-b6ce-81599b70c3b6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:35.381696 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-120f73e3-1db4-458b-b6ce-81599b70c3b6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:35.382531 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-120f73e3-1db4-458b-b6ce-81599b70c3b6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:35.383127 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-120f73e3-1db4-458b-b6ce-81599b70c3b6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:35.385201 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-120f73e3-1db4-458b-b6ce-81599b70c3b6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:35.385961 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-120f73e3-1db4-458b-b6ce-81599b70c3b6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:35.386676 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-120f73e3-1db4-458b-b6ce-81599b70c3b6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:35.487648 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-120f73e3-1db4-458b-b6ce-81599b70c3b6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:35.496303 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-120f73e3-1db4-458b-b6ce-81599b70c3b6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1294 microversion: 2.1 time: 0.127609 Sep 09 12:58:35.496878 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 99/192] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:35 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1294 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:35.817332 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0d8b48a2-5121-42d3-abc1-f506a90de4e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:35.818651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-0d8b48a2-5121-42d3-abc1-f506a90de4e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:35.825578 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0d8b48a2-5121-42d3-abc1-f506a90de4e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:35.826399 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0d8b48a2-5121-42d3-abc1-f506a90de4e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:35.827076 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0d8b48a2-5121-42d3-abc1-f506a90de4e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:35.827959 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0d8b48a2-5121-42d3-abc1-f506a90de4e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:35.828665 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0d8b48a2-5121-42d3-abc1-f506a90de4e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:35.829237 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0d8b48a2-5121-42d3-abc1-f506a90de4e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:35.973356 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-0d8b48a2-5121-42d3-abc1-f506a90de4e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:35.983108 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-0d8b48a2-5121-42d3-abc1-f506a90de4e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:35.986427 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-0d8b48a2-5121-42d3-abc1-f506a90de4e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:35.987749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0d8b48a2-5121-42d3-abc1-f506a90de4e9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1744 microversion: 2.20 time: 0.174456 Sep 09 12:58:35.988329 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 94/193] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:35 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1744 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:36.250883 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-804fbbbd-e467-43a6-bbb7-0205f81a092b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:36.251863 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-804fbbbd-e467-43a6-bbb7-0205f81a092b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:36.261785 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-804fbbbd-e467-43a6-bbb7-0205f81a092b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:36.261785 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-804fbbbd-e467-43a6-bbb7-0205f81a092b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:36.262402 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-804fbbbd-e467-43a6-bbb7-0205f81a092b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:36.263330 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-804fbbbd-e467-43a6-bbb7-0205f81a092b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:36.264385 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-804fbbbd-e467-43a6-bbb7-0205f81a092b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:36.264823 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-804fbbbd-e467-43a6-bbb7-0205f81a092b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:36.519464 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-47853ea5-4632-4588-a139-ddb120f8dade tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:36.520071 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-47853ea5-4632-4588-a139-ddb120f8dade tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:36.528376 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47853ea5-4632-4588-a139-ddb120f8dade tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:36.529078 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47853ea5-4632-4588-a139-ddb120f8dade tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:36.529721 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47853ea5-4632-4588-a139-ddb120f8dade tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:36.531111 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47853ea5-4632-4588-a139-ddb120f8dade tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:36.531771 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47853ea5-4632-4588-a139-ddb120f8dade tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:36.532450 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47853ea5-4632-4588-a139-ddb120f8dade tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:36.603488 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-47853ea5-4632-4588-a139-ddb120f8dade tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:36.611689 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-47853ea5-4632-4588-a139-ddb120f8dade tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1300 microversion: 2.1 time: 0.096328 Sep 09 12:58:36.612256 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 95/194] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:36 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:36.711902 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-804fbbbd-e467-43a6-bbb7-0205f81a092b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:36.719947 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-804fbbbd-e467-43a6-bbb7-0205f81a092b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.477820 Sep 09 12:58:36.720530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 100/195] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:36 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:37.016349 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-266c244f-5ba2-4efa-8a54-c5190a7a0a1c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:37.016966 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-266c244f-5ba2-4efa-8a54-c5190a7a0a1c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:37.023757 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-266c244f-5ba2-4efa-8a54-c5190a7a0a1c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:37.024568 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-266c244f-5ba2-4efa-8a54-c5190a7a0a1c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:37.025237 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-266c244f-5ba2-4efa-8a54-c5190a7a0a1c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:37.026454 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-266c244f-5ba2-4efa-8a54-c5190a7a0a1c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:37.026945 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-266c244f-5ba2-4efa-8a54-c5190a7a0a1c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:37.027370 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-266c244f-5ba2-4efa-8a54-c5190a7a0a1c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:37.047895 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:58:37.196297 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-266c244f-5ba2-4efa-8a54-c5190a7a0a1c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:37.234213 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-266c244f-5ba2-4efa-8a54-c5190a7a0a1c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:37.250709 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-266c244f-5ba2-4efa-8a54-c5190a7a0a1c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:37.250709 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-266c244f-5ba2-4efa-8a54-c5190a7a0a1c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1744 microversion: 2.20 time: 0.224963 Sep 09 12:58:37.250709 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 96/196] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:37 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1744 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:37.635896 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-228af06a-6a89-47ef-8168-786976b736b2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:37.636952 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-228af06a-6a89-47ef-8168-786976b736b2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:37.656710 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-228af06a-6a89-47ef-8168-786976b736b2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:37.662060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-228af06a-6a89-47ef-8168-786976b736b2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:37.662060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-228af06a-6a89-47ef-8168-786976b736b2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:37.662060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-228af06a-6a89-47ef-8168-786976b736b2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:37.662060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-228af06a-6a89-47ef-8168-786976b736b2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:37.662509 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-228af06a-6a89-47ef-8168-786976b736b2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:37.742601 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2ae4efbf-7b69-4d8f-b69e-45fd632fe5e1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:37.743487 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2ae4efbf-7b69-4d8f-b69e-45fd632fe5e1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:37.752168 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ae4efbf-7b69-4d8f-b69e-45fd632fe5e1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:37.752759 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ae4efbf-7b69-4d8f-b69e-45fd632fe5e1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:37.753295 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ae4efbf-7b69-4d8f-b69e-45fd632fe5e1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:37.755756 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ae4efbf-7b69-4d8f-b69e-45fd632fe5e1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:37.756416 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ae4efbf-7b69-4d8f-b69e-45fd632fe5e1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:37.756958 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ae4efbf-7b69-4d8f-b69e-45fd632fe5e1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:37.986525 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-228af06a-6a89-47ef-8168-786976b736b2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:38.000209 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-228af06a-6a89-47ef-8168-786976b736b2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1368 microversion: 2.1 time: 0.368493 Sep 09 12:58:38.003186 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 101/197] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:37 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1368 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:38.019671 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-1d2d0216-b9fc-42e5-95e6-39a6d47dd41f req-49c359ca-eba1-4673-9ff6-59e4f232c40a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78dad9a3-ac85-4014-829c-986cca18c8b1", "name": "network-vif-plugged", "status": "completed", "tag": "244f1be5-c384-494f-b53f-53fb6f1b2689"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:58:38.029715 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2ae4efbf-7b69-4d8f-b69e-45fd632fe5e1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:38.037181 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-1d2d0216-b9fc-42e5-95e6-39a6d47dd41f req-49c359ca-eba1-4673-9ff6-59e4f232c40a service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:38.037670 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-1d2d0216-b9fc-42e5-95e6-39a6d47dd41f req-49c359ca-eba1-4673-9ff6-59e4f232c40a service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:38.038101 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-1d2d0216-b9fc-42e5-95e6-39a6d47dd41f req-49c359ca-eba1-4673-9ff6-59e4f232c40a service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:38.040356 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2ae4efbf-7b69-4d8f-b69e-45fd632fe5e1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.301503 Sep 09 12:58:38.042146 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 97/198] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:37 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:38.061035 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-1d2d0216-b9fc-42e5-95e6-39a6d47dd41f req-49c359ca-eba1-4673-9ff6-59e4f232c40a service nova] Creating event network-vif-plugged:244f1be5-c384-494f-b53f-53fb6f1b2689 for instance 78dad9a3-ac85-4014-829c-986cca18c8b1 on hv-cinder-81322 Sep 09 12:58:38.068012 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-1d2d0216-b9fc-42e5-95e6-39a6d47dd41f req-49c359ca-eba1-4673-9ff6-59e4f232c40a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063265 Sep 09 12:58:38.068612 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 102/199] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:58:38.268379 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-6ea6f840-3fd8-4d7c-b8ac-37e8678b7363 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:38.269242 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-6ea6f840-3fd8-4d7c-b8ac-37e8678b7363 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:38.276749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6ea6f840-3fd8-4d7c-b8ac-37e8678b7363 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:38.277646 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6ea6f840-3fd8-4d7c-b8ac-37e8678b7363 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:38.278285 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6ea6f840-3fd8-4d7c-b8ac-37e8678b7363 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:38.280417 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6ea6f840-3fd8-4d7c-b8ac-37e8678b7363 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:38.281063 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6ea6f840-3fd8-4d7c-b8ac-37e8678b7363 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:38.281653 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6ea6f840-3fd8-4d7c-b8ac-37e8678b7363 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:38.437033 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-6ea6f840-3fd8-4d7c-b8ac-37e8678b7363 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:38.449710 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-6ea6f840-3fd8-4d7c-b8ac-37e8678b7363 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:38.452156 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-6ea6f840-3fd8-4d7c-b8ac-37e8678b7363 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:38.454201 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-6ea6f840-3fd8-4d7c-b8ac-37e8678b7363 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1739 microversion: 2.20 time: 0.191674 Sep 09 12:58:38.455033 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 98/200] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:38 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:58:39.027117 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c89fa2f9-0bb9-4a7e-9f6f-4a1eea0aee8b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:39.028403 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-c89fa2f9-0bb9-4a7e-9f6f-4a1eea0aee8b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:39.037555 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c89fa2f9-0bb9-4a7e-9f6f-4a1eea0aee8b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:39.038219 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c89fa2f9-0bb9-4a7e-9f6f-4a1eea0aee8b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:39.039369 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c89fa2f9-0bb9-4a7e-9f6f-4a1eea0aee8b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:39.043907 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c89fa2f9-0bb9-4a7e-9f6f-4a1eea0aee8b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:39.043907 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c89fa2f9-0bb9-4a7e-9f6f-4a1eea0aee8b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:39.043907 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c89fa2f9-0bb9-4a7e-9f6f-4a1eea0aee8b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:39.065920 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-fb4cff10-3582-4550-9896-ad41f700c3c4 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:39.067226 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-fb4cff10-3582-4550-9896-ad41f700c3c4 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:39.078812 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fb4cff10-3582-4550-9896-ad41f700c3c4 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:39.079404 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fb4cff10-3582-4550-9896-ad41f700c3c4 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:39.081231 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fb4cff10-3582-4550-9896-ad41f700c3c4 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:39.085352 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fb4cff10-3582-4550-9896-ad41f700c3c4 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:39.086148 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fb4cff10-3582-4550-9896-ad41f700c3c4 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:39.089471 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fb4cff10-3582-4550-9896-ad41f700c3c4 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:39.314537 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-fb4cff10-3582-4550-9896-ad41f700c3c4 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:39.324573 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-fb4cff10-3582-4550-9896-ad41f700c3c4 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.263437 Sep 09 12:58:39.325990 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 99/201] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:39 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:39.484644 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-adf6ec87-187d-4e6e-94a4-0223a7d71066 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:39.485437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-adf6ec87-187d-4e6e-94a4-0223a7d71066 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:39.492230 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-adf6ec87-187d-4e6e-94a4-0223a7d71066 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:39.492812 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-adf6ec87-187d-4e6e-94a4-0223a7d71066 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:39.493186 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-adf6ec87-187d-4e6e-94a4-0223a7d71066 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:39.500268 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-adf6ec87-187d-4e6e-94a4-0223a7d71066 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:39.505973 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-adf6ec87-187d-4e6e-94a4-0223a7d71066 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:39.506794 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-adf6ec87-187d-4e6e-94a4-0223a7d71066 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:39.672569 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c89fa2f9-0bb9-4a7e-9f6f-4a1eea0aee8b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:39.692102 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-c89fa2f9-0bb9-4a7e-9f6f-4a1eea0aee8b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1368 microversion: 2.1 time: 0.670076 Sep 09 12:58:39.695617 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 103/202] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:39 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1368 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:39.807820 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-adf6ec87-187d-4e6e-94a4-0223a7d71066 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:39.824956 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-adf6ec87-187d-4e6e-94a4-0223a7d71066 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:39.826917 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-adf6ec87-187d-4e6e-94a4-0223a7d71066 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:39.827859 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-adf6ec87-187d-4e6e-94a4-0223a7d71066 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1739 microversion: 2.20 time: 0.347849 Sep 09 12:58:39.829154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 100/203] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:39 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1739 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:40.067221 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-54b7cb7b-72c1-4291-91c8-bebf2abfceeb req-c8bd0674-abf7-4263-a337-a5f5f965d920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1da39a54-b8f3-49a7-9447-497fadd2cefb", "tag": "e5f34505-ba7c-40ff-b43f-cf15fb7702b3"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:58:40.078061 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-54b7cb7b-72c1-4291-91c8-bebf2abfceeb req-c8bd0674-abf7-4263-a337-a5f5f965d920 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:40.079057 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-54b7cb7b-72c1-4291-91c8-bebf2abfceeb req-c8bd0674-abf7-4263-a337-a5f5f965d920 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:40.079660 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-54b7cb7b-72c1-4291-91c8-bebf2abfceeb req-c8bd0674-abf7-4263-a337-a5f5f965d920 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:40.091656 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-54b7cb7b-72c1-4291-91c8-bebf2abfceeb req-c8bd0674-abf7-4263-a337-a5f5f965d920 service nova] Creating event network-changed:e5f34505-ba7c-40ff-b43f-cf15fb7702b3 for instance 1da39a54-b8f3-49a7-9447-497fadd2cefb on hv-cinder-81322 Sep 09 12:58:40.096708 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-54b7cb7b-72c1-4291-91c8-bebf2abfceeb req-c8bd0674-abf7-4263-a337-a5f5f965d920 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033050 Sep 09 12:58:40.097888 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 104/204] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:58:40.349397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a2e5bf14-e409-4545-afa2-06eebea93fbc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:40.350298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-a2e5bf14-e409-4545-afa2-06eebea93fbc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:40.362708 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a2e5bf14-e409-4545-afa2-06eebea93fbc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:40.363202 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a2e5bf14-e409-4545-afa2-06eebea93fbc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:40.364080 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a2e5bf14-e409-4545-afa2-06eebea93fbc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:40.364949 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a2e5bf14-e409-4545-afa2-06eebea93fbc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:40.365608 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a2e5bf14-e409-4545-afa2-06eebea93fbc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:40.366267 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a2e5bf14-e409-4545-afa2-06eebea93fbc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:40.569396 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-a2e5bf14-e409-4545-afa2-06eebea93fbc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:40.618199 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-a2e5bf14-e409-4545-afa2-06eebea93fbc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.273145 Sep 09 12:58:40.635804 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 101/205] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:40 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:40.747960 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-805d7ba6-7d29-4d5b-84ee-c3c12129613b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:40.749515 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-805d7ba6-7d29-4d5b-84ee-c3c12129613b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:40.769514 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-805d7ba6-7d29-4d5b-84ee-c3c12129613b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:40.770236 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-805d7ba6-7d29-4d5b-84ee-c3c12129613b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:40.770936 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-805d7ba6-7d29-4d5b-84ee-c3c12129613b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:40.772257 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-805d7ba6-7d29-4d5b-84ee-c3c12129613b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:40.772773 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-805d7ba6-7d29-4d5b-84ee-c3c12129613b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:40.773268 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-805d7ba6-7d29-4d5b-84ee-c3c12129613b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:40.859262 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-c9f59138-4644-4ce6-b4e3-d468299bc00e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:40.860168 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-c9f59138-4644-4ce6-b4e3-d468299bc00e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:40.869085 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c9f59138-4644-4ce6-b4e3-d468299bc00e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:40.869679 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c9f59138-4644-4ce6-b4e3-d468299bc00e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:40.870236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c9f59138-4644-4ce6-b4e3-d468299bc00e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:40.871030 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c9f59138-4644-4ce6-b4e3-d468299bc00e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:40.873946 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c9f59138-4644-4ce6-b4e3-d468299bc00e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:40.873946 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c9f59138-4644-4ce6-b4e3-d468299bc00e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:40.967502 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-805d7ba6-7d29-4d5b-84ee-c3c12129613b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:40.989866 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-805d7ba6-7d29-4d5b-84ee-c3c12129613b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1368 microversion: 2.1 time: 0.255454 Sep 09 12:58:40.996008 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 105/206] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:40 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1368 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:41.061249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-c9f59138-4644-4ce6-b4e3-d468299bc00e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:41.071596 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-c9f59138-4644-4ce6-b4e3-d468299bc00e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:41.074599 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-c9f59138-4644-4ce6-b4e3-d468299bc00e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:41.075895 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-c9f59138-4644-4ce6-b4e3-d468299bc00e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1739 microversion: 2.20 time: 0.223340 Sep 09 12:58:41.076872 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 102/207] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:40 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:41.646698 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-8f64c61d-32d6-4428-aa07-a49ce881984b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:41.647188 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-8f64c61d-32d6-4428-aa07-a49ce881984b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:41.654498 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8f64c61d-32d6-4428-aa07-a49ce881984b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:41.655009 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8f64c61d-32d6-4428-aa07-a49ce881984b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:41.655451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8f64c61d-32d6-4428-aa07-a49ce881984b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:41.656205 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8f64c61d-32d6-4428-aa07-a49ce881984b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:41.656609 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8f64c61d-32d6-4428-aa07-a49ce881984b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:41.657190 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8f64c61d-32d6-4428-aa07-a49ce881984b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:41.986134 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-8f64c61d-32d6-4428-aa07-a49ce881984b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:41.996591 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-8f64c61d-32d6-4428-aa07-a49ce881984b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.353979 Sep 09 12:58:42.007223 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 106/208] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:41 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:42.020476 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-29f6dd0c-4b7a-41af-a561-1c2498665432 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:42.021674 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-29f6dd0c-4b7a-41af-a561-1c2498665432 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:42.033429 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-29f6dd0c-4b7a-41af-a561-1c2498665432 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:42.035031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-29f6dd0c-4b7a-41af-a561-1c2498665432 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:42.035031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-29f6dd0c-4b7a-41af-a561-1c2498665432 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:42.035832 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-29f6dd0c-4b7a-41af-a561-1c2498665432 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:42.036452 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-29f6dd0c-4b7a-41af-a561-1c2498665432 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:42.037037 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-29f6dd0c-4b7a-41af-a561-1c2498665432 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:42.119889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-320709e7-5196-4330-a02e-d3c30dcf5c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:42.120875 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-320709e7-5196-4330-a02e-d3c30dcf5c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:42.142745 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-320709e7-5196-4330-a02e-d3c30dcf5c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:42.143455 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-320709e7-5196-4330-a02e-d3c30dcf5c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:42.143916 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-320709e7-5196-4330-a02e-d3c30dcf5c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:42.145464 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-320709e7-5196-4330-a02e-d3c30dcf5c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:42.145953 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-320709e7-5196-4330-a02e-d3c30dcf5c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:42.146396 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-320709e7-5196-4330-a02e-d3c30dcf5c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:42.237949 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-29f6dd0c-4b7a-41af-a561-1c2498665432 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:42.237949 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-29f6dd0c-4b7a-41af-a561-1c2498665432 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1368 microversion: 2.1 time: 0.217777 Sep 09 12:58:42.237949 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 103/209] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:42 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:58:42.407226 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-320709e7-5196-4330-a02e-d3c30dcf5c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:42.418447 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-320709e7-5196-4330-a02e-d3c30dcf5c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:42.420402 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-320709e7-5196-4330-a02e-d3c30dcf5c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:42.422145 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-320709e7-5196-4330-a02e-d3c30dcf5c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1739 microversion: 2.20 time: 0.305781 Sep 09 12:58:42.422856 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 107/210] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:42 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1739 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:43.038078 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-b87aa547-e1e7-4e78-bbfd-ba1c392dd54f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:43.038778 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-b87aa547-e1e7-4e78-bbfd-ba1c392dd54f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:43.043019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=2 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:58:43.044594 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=10 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:58:43.058938 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b87aa547-e1e7-4e78-bbfd-ba1c392dd54f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:43.062256 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b87aa547-e1e7-4e78-bbfd-ba1c392dd54f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:43.062943 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b87aa547-e1e7-4e78-bbfd-ba1c392dd54f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:43.063950 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b87aa547-e1e7-4e78-bbfd-ba1c392dd54f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:43.064708 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b87aa547-e1e7-4e78-bbfd-ba1c392dd54f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:43.065341 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b87aa547-e1e7-4e78-bbfd-ba1c392dd54f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:43.258600 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-eab2d5be-1be9-42d5-877e-eb70bc08d1ea tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:43.260898 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-eab2d5be-1be9-42d5-877e-eb70bc08d1ea tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:43.264612 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=2 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:58:43.275071 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-eab2d5be-1be9-42d5-877e-eb70bc08d1ea tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:43.277240 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-eab2d5be-1be9-42d5-877e-eb70bc08d1ea tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:43.278068 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-eab2d5be-1be9-42d5-877e-eb70bc08d1ea tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:43.279571 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-eab2d5be-1be9-42d5-877e-eb70bc08d1ea tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:43.280564 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-eab2d5be-1be9-42d5-877e-eb70bc08d1ea tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:43.281426 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-eab2d5be-1be9-42d5-877e-eb70bc08d1ea tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:43.381290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-b87aa547-e1e7-4e78-bbfd-ba1c392dd54f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:43.419081 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-b87aa547-e1e7-4e78-bbfd-ba1c392dd54f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.396256 Sep 09 12:58:43.423327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 104/211] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:43 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:43.453712 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-c6f9bad3-c975-4f42-b6bf-dd440ace5376 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:43.454709 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-c6f9bad3-c975-4f42-b6bf-dd440ace5376 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:43.468915 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c6f9bad3-c975-4f42-b6bf-dd440ace5376 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:43.469796 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c6f9bad3-c975-4f42-b6bf-dd440ace5376 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:43.473386 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c6f9bad3-c975-4f42-b6bf-dd440ace5376 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:43.474530 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c6f9bad3-c975-4f42-b6bf-dd440ace5376 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:43.475215 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c6f9bad3-c975-4f42-b6bf-dd440ace5376 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:43.475852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c6f9bad3-c975-4f42-b6bf-dd440ace5376 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:43.533262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-eab2d5be-1be9-42d5-877e-eb70bc08d1ea tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:43.548081 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-eab2d5be-1be9-42d5-877e-eb70bc08d1ea tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1368 microversion: 2.1 time: 0.294688 Sep 09 12:58:43.565950 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 108/212] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:43 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1368 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:58:43.691910 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-c6f9bad3-c975-4f42-b6bf-dd440ace5376 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:43.700157 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-c6f9bad3-c975-4f42-b6bf-dd440ace5376 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:43.702445 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-c6f9bad3-c975-4f42-b6bf-dd440ace5376 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:43.708710 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-c6f9bad3-c975-4f42-b6bf-dd440ace5376 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1739 microversion: 2.20 time: 0.263344 Sep 09 12:58:43.710180 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 105/213] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:43 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:58:44.450295 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-912d6753-fa4e-494f-95d7-63e9ea7b8ec1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:44.451774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-912d6753-fa4e-494f-95d7-63e9ea7b8ec1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:44.468053 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-912d6753-fa4e-494f-95d7-63e9ea7b8ec1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:44.470328 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-912d6753-fa4e-494f-95d7-63e9ea7b8ec1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:44.470806 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-912d6753-fa4e-494f-95d7-63e9ea7b8ec1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:44.474362 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-912d6753-fa4e-494f-95d7-63e9ea7b8ec1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:44.474907 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-912d6753-fa4e-494f-95d7-63e9ea7b8ec1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:44.475354 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-912d6753-fa4e-494f-95d7-63e9ea7b8ec1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:44.576775 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2ee80a56-4ce8-4208-be4e-da39d1edabe9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:44.577818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2ee80a56-4ce8-4208-be4e-da39d1edabe9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:44.586560 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ee80a56-4ce8-4208-be4e-da39d1edabe9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:44.587922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ee80a56-4ce8-4208-be4e-da39d1edabe9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:44.588934 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ee80a56-4ce8-4208-be4e-da39d1edabe9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:44.594698 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ee80a56-4ce8-4208-be4e-da39d1edabe9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:44.596311 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ee80a56-4ce8-4208-be4e-da39d1edabe9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:44.597049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ee80a56-4ce8-4208-be4e-da39d1edabe9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:44.720973 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-912d6753-fa4e-494f-95d7-63e9ea7b8ec1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:44.730835 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-912d6753-fa4e-494f-95d7-63e9ea7b8ec1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.286056 Sep 09 12:58:44.735624 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 109/214] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:44 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:44.742009 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-51f92081-d91d-4d75-b5e0-31df71151878 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:44.742641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-51f92081-d91d-4d75-b5e0-31df71151878 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:44.758505 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-51f92081-d91d-4d75-b5e0-31df71151878 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:44.761081 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-51f92081-d91d-4d75-b5e0-31df71151878 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:44.761081 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-51f92081-d91d-4d75-b5e0-31df71151878 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:44.762619 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-51f92081-d91d-4d75-b5e0-31df71151878 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:44.763240 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-51f92081-d91d-4d75-b5e0-31df71151878 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:44.763851 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-51f92081-d91d-4d75-b5e0-31df71151878 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:44.887558 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2ee80a56-4ce8-4208-be4e-da39d1edabe9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:44.899115 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2ee80a56-4ce8-4208-be4e-da39d1edabe9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1368 microversion: 2.1 time: 0.328123 Sep 09 12:58:44.899115 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 106/215] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:44 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1368 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:58:44.985625 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-51f92081-d91d-4d75-b5e0-31df71151878 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:44.998381 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-51f92081-d91d-4d75-b5e0-31df71151878 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:45.002198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-51f92081-d91d-4d75-b5e0-31df71151878 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:45.003663 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-51f92081-d91d-4d75-b5e0-31df71151878 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1739 microversion: 2.20 time: 0.266217 Sep 09 12:58:45.004544 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 110/216] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:44 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1739 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:45.765910 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-de29e201-9432-4c58-931f-81d125bb8f28 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:45.768482 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-de29e201-9432-4c58-931f-81d125bb8f28 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:45.777615 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-de29e201-9432-4c58-931f-81d125bb8f28 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:45.778779 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-de29e201-9432-4c58-931f-81d125bb8f28 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:45.779457 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-de29e201-9432-4c58-931f-81d125bb8f28 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:45.780630 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-de29e201-9432-4c58-931f-81d125bb8f28 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:45.781492 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-de29e201-9432-4c58-931f-81d125bb8f28 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:45.782167 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-de29e201-9432-4c58-931f-81d125bb8f28 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:45.925604 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-fe4485a7-fbf9-4ce4-996b-a7be38cc9fa2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:45.926228 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-fe4485a7-fbf9-4ce4-996b-a7be38cc9fa2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:45.934799 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fe4485a7-fbf9-4ce4-996b-a7be38cc9fa2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:45.935311 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fe4485a7-fbf9-4ce4-996b-a7be38cc9fa2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:45.935746 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fe4485a7-fbf9-4ce4-996b-a7be38cc9fa2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:45.936462 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fe4485a7-fbf9-4ce4-996b-a7be38cc9fa2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:45.936932 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fe4485a7-fbf9-4ce4-996b-a7be38cc9fa2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:45.937366 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fe4485a7-fbf9-4ce4-996b-a7be38cc9fa2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:46.171172 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-fe4485a7-fbf9-4ce4-996b-a7be38cc9fa2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:46.182788 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-fe4485a7-fbf9-4ce4-996b-a7be38cc9fa2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1368 microversion: 2.1 time: 0.262028 Sep 09 12:58:46.198508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 111/217] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:45 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1368 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:58:46.201347 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e6841853-971a-4e4d-9c36-5d8ea5070761 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:46.201965 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e6841853-971a-4e4d-9c36-5d8ea5070761 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:46.212086 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e6841853-971a-4e4d-9c36-5d8ea5070761 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:46.212981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e6841853-971a-4e4d-9c36-5d8ea5070761 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:46.213701 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e6841853-971a-4e4d-9c36-5d8ea5070761 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:46.215209 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e6841853-971a-4e4d-9c36-5d8ea5070761 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:46.215823 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e6841853-971a-4e4d-9c36-5d8ea5070761 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:46.216717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e6841853-971a-4e4d-9c36-5d8ea5070761 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:46.388478 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-de29e201-9432-4c58-931f-81d125bb8f28 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:46.397892 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-de29e201-9432-4c58-931f-81d125bb8f28 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.637190 Sep 09 12:58:46.410862 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 107/218] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:45 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:46.473085 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e6841853-971a-4e4d-9c36-5d8ea5070761 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:46.485958 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e6841853-971a-4e4d-9c36-5d8ea5070761 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:46.488111 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e6841853-971a-4e4d-9c36-5d8ea5070761 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:46.492039 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e6841853-971a-4e4d-9c36-5d8ea5070761 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1739 microversion: 2.20 time: 0.293065 Sep 09 12:58:46.492039 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 112/219] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:46 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1739 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:47.212245 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2c247400-0c8b-440a-96c8-8c976f2f695f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:47.213070 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2c247400-0c8b-440a-96c8-8c976f2f695f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:47.222394 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2c247400-0c8b-440a-96c8-8c976f2f695f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:47.223229 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2c247400-0c8b-440a-96c8-8c976f2f695f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:47.223881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2c247400-0c8b-440a-96c8-8c976f2f695f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:47.225134 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2c247400-0c8b-440a-96c8-8c976f2f695f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:47.225798 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2c247400-0c8b-440a-96c8-8c976f2f695f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:47.226539 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2c247400-0c8b-440a-96c8-8c976f2f695f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:47.400551 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2c247400-0c8b-440a-96c8-8c976f2f695f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:47.408347 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2c247400-0c8b-440a-96c8-8c976f2f695f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1368 microversion: 2.1 time: 0.205624 Sep 09 12:58:47.408911 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 108/220] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:47 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:47.440012 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-f0fc03ca-a8fd-4530-a545-e0410b1961b0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:47.459766 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-f0fc03ca-a8fd-4530-a545-e0410b1961b0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:47.459766 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f0fc03ca-a8fd-4530-a545-e0410b1961b0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:47.459766 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f0fc03ca-a8fd-4530-a545-e0410b1961b0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:47.459766 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f0fc03ca-a8fd-4530-a545-e0410b1961b0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:47.460292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f0fc03ca-a8fd-4530-a545-e0410b1961b0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:47.460292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f0fc03ca-a8fd-4530-a545-e0410b1961b0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:47.460292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f0fc03ca-a8fd-4530-a545-e0410b1961b0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:47.519726 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-9fed91dd-c407-415b-83e2-b046a8f08e0a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:47.520518 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-9fed91dd-c407-415b-83e2-b046a8f08e0a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:47.526689 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9fed91dd-c407-415b-83e2-b046a8f08e0a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:47.527313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9fed91dd-c407-415b-83e2-b046a8f08e0a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:47.527781 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9fed91dd-c407-415b-83e2-b046a8f08e0a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:47.528513 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9fed91dd-c407-415b-83e2-b046a8f08e0a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:47.528971 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9fed91dd-c407-415b-83e2-b046a8f08e0a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:47.529400 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9fed91dd-c407-415b-83e2-b046a8f08e0a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:47.602404 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-f0fc03ca-a8fd-4530-a545-e0410b1961b0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:47.612441 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-f0fc03ca-a8fd-4530-a545-e0410b1961b0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.176594 Sep 09 12:58:47.613282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 113/221] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:47 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:47.731854 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-cbcd9640-255b-4e37-b873-56f6878b77f5 req-3fc08cb5-b231-4509-8223-aa82fa333f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da39a54-b8f3-49a7-9447-497fadd2cefb", "name": "network-vif-plugged", "status": "completed", "tag": "e5f34505-ba7c-40ff-b43f-cf15fb7702b3"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:58:47.759643 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-cbcd9640-255b-4e37-b873-56f6878b77f5 req-3fc08cb5-b231-4509-8223-aa82fa333f04 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:47.760728 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-cbcd9640-255b-4e37-b873-56f6878b77f5 req-3fc08cb5-b231-4509-8223-aa82fa333f04 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:47.761381 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-cbcd9640-255b-4e37-b873-56f6878b77f5 req-3fc08cb5-b231-4509-8223-aa82fa333f04 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:47.776489 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-cbcd9640-255b-4e37-b873-56f6878b77f5 req-3fc08cb5-b231-4509-8223-aa82fa333f04 service nova] Creating event network-vif-plugged:e5f34505-ba7c-40ff-b43f-cf15fb7702b3 for instance 1da39a54-b8f3-49a7-9447-497fadd2cefb on hv-cinder-81322 Sep 09 12:58:47.782036 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-cbcd9640-255b-4e37-b873-56f6878b77f5 req-3fc08cb5-b231-4509-8223-aa82fa333f04 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054950 Sep 09 12:58:47.783385 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 114/222] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:58:47.796251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-9fed91dd-c407-415b-83e2-b046a8f08e0a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:47.811477 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-9fed91dd-c407-415b-83e2-b046a8f08e0a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:47.812942 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-9fed91dd-c407-415b-83e2-b046a8f08e0a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:47.818839 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-9fed91dd-c407-415b-83e2-b046a8f08e0a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1739 microversion: 2.20 time: 0.303077 Sep 09 12:58:47.819671 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 109/223] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:47 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1739 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:58:48.434274 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-6811085a-ed76-4bf1-848e-446c62707386 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:48.435779 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-6811085a-ed76-4bf1-848e-446c62707386 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:48.449778 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6811085a-ed76-4bf1-848e-446c62707386 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:48.452417 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6811085a-ed76-4bf1-848e-446c62707386 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:48.453943 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6811085a-ed76-4bf1-848e-446c62707386 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:48.459458 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6811085a-ed76-4bf1-848e-446c62707386 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:48.465970 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6811085a-ed76-4bf1-848e-446c62707386 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:48.468849 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6811085a-ed76-4bf1-848e-446c62707386 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:48.637973 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ab690503-4d3e-471f-82a2-7856b53fc3bc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:48.639327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ab690503-4d3e-471f-82a2-7856b53fc3bc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:48.657135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ab690503-4d3e-471f-82a2-7856b53fc3bc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:48.657627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ab690503-4d3e-471f-82a2-7856b53fc3bc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:48.663353 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ab690503-4d3e-471f-82a2-7856b53fc3bc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:48.666925 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ab690503-4d3e-471f-82a2-7856b53fc3bc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:48.670218 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ab690503-4d3e-471f-82a2-7856b53fc3bc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:48.671134 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ab690503-4d3e-471f-82a2-7856b53fc3bc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:48.705397 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-6811085a-ed76-4bf1-848e-446c62707386 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:48.720800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-6811085a-ed76-4bf1-848e-446c62707386 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1368 microversion: 2.1 time: 0.291483 Sep 09 12:58:48.731951 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 115/224] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:48 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1368 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:48.850619 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a4fa0200-6de0-47a5-b676-2ad10c7a80e8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:48.851227 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a4fa0200-6de0-47a5-b676-2ad10c7a80e8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:48.863919 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a4fa0200-6de0-47a5-b676-2ad10c7a80e8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:48.866984 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a4fa0200-6de0-47a5-b676-2ad10c7a80e8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:48.869868 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a4fa0200-6de0-47a5-b676-2ad10c7a80e8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:48.870716 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a4fa0200-6de0-47a5-b676-2ad10c7a80e8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:48.871164 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a4fa0200-6de0-47a5-b676-2ad10c7a80e8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:48.871592 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a4fa0200-6de0-47a5-b676-2ad10c7a80e8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:48.929259 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=100 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:58:49.082774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ab690503-4d3e-471f-82a2-7856b53fc3bc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:49.122867 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ab690503-4d3e-471f-82a2-7856b53fc3bc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.486070 Sep 09 12:58:49.162691 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 110/225] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:48 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:49.239639 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a4fa0200-6de0-47a5-b676-2ad10c7a80e8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:49.262164 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a4fa0200-6de0-47a5-b676-2ad10c7a80e8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:49.269891 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a4fa0200-6de0-47a5-b676-2ad10c7a80e8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:49.271149 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a4fa0200-6de0-47a5-b676-2ad10c7a80e8 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1739 microversion: 2.20 time: 0.425192 Sep 09 12:58:49.275848 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 116/226] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:48 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1739 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:49.762990 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-39580ecf-82bb-4ef7-9647-e2c209390eb7 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:49.763617 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-39580ecf-82bb-4ef7-9647-e2c209390eb7 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:49.796585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-39580ecf-82bb-4ef7-9647-e2c209390eb7 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:49.797717 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-39580ecf-82bb-4ef7-9647-e2c209390eb7 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:49.801428 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-39580ecf-82bb-4ef7-9647-e2c209390eb7 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:49.803379 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-39580ecf-82bb-4ef7-9647-e2c209390eb7 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:49.804019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-39580ecf-82bb-4ef7-9647-e2c209390eb7 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:49.806059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-39580ecf-82bb-4ef7-9647-e2c209390eb7 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:50.048474 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-39580ecf-82bb-4ef7-9647-e2c209390eb7 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:50.058002 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-39580ecf-82bb-4ef7-9647-e2c209390eb7 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1368 microversion: 2.1 time: 0.302943 Sep 09 12:58:50.061928 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 111/227] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:49 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1368 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:50.158727 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-fb934903-fb67-4922-8fb8-93390e81d0c7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:50.160095 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-fb934903-fb67-4922-8fb8-93390e81d0c7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:50.172871 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fb934903-fb67-4922-8fb8-93390e81d0c7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:50.175331 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fb934903-fb67-4922-8fb8-93390e81d0c7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:50.176040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fb934903-fb67-4922-8fb8-93390e81d0c7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:50.178200 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fb934903-fb67-4922-8fb8-93390e81d0c7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:50.180021 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fb934903-fb67-4922-8fb8-93390e81d0c7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:50.180653 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fb934903-fb67-4922-8fb8-93390e81d0c7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:50.303229 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a45635ab-4de5-4492-9e24-f27620a83604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:50.306705 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-a45635ab-4de5-4492-9e24-f27620a83604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:50.318954 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a45635ab-4de5-4492-9e24-f27620a83604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:50.319613 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a45635ab-4de5-4492-9e24-f27620a83604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:50.320229 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a45635ab-4de5-4492-9e24-f27620a83604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:50.321167 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a45635ab-4de5-4492-9e24-f27620a83604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:50.322301 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a45635ab-4de5-4492-9e24-f27620a83604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:50.322826 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a45635ab-4de5-4492-9e24-f27620a83604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:50.407402 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-fb934903-fb67-4922-8fb8-93390e81d0c7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:50.417581 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-fb934903-fb67-4922-8fb8-93390e81d0c7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.263443 Sep 09 12:58:50.418772 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 117/228] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:50 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:50.664499 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-a45635ab-4de5-4492-9e24-f27620a83604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:50.676569 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-a45635ab-4de5-4492-9e24-f27620a83604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:50.678643 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-a45635ab-4de5-4492-9e24-f27620a83604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:50.680122 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-a45635ab-4de5-4492-9e24-f27620a83604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1739 microversion: 2.20 time: 0.385282 Sep 09 12:58:50.682017 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 112/229] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:50 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1739 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:51.116849 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e4f64b6a-0c3e-4e60-b0b4-69d386a8671f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:51.116849 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e4f64b6a-0c3e-4e60-b0b4-69d386a8671f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:51.137837 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e4f64b6a-0c3e-4e60-b0b4-69d386a8671f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:51.138557 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e4f64b6a-0c3e-4e60-b0b4-69d386a8671f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:51.140589 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e4f64b6a-0c3e-4e60-b0b4-69d386a8671f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:51.141497 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e4f64b6a-0c3e-4e60-b0b4-69d386a8671f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:51.143022 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e4f64b6a-0c3e-4e60-b0b4-69d386a8671f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:51.144437 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e4f64b6a-0c3e-4e60-b0b4-69d386a8671f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:51.351026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e4f64b6a-0c3e-4e60-b0b4-69d386a8671f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:51.360075 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e4f64b6a-0c3e-4e60-b0b4-69d386a8671f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1558 microversion: 2.1 time: 0.271055 Sep 09 12:58:51.360666 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 118/230] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:51 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1558 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:51.396758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-7399f90d-3da8-4f36-be0c-c82b14325f8a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:51.396758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-7399f90d-3da8-4f36-be0c-c82b14325f8a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:51.419992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7399f90d-3da8-4f36-be0c-c82b14325f8a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:51.420656 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7399f90d-3da8-4f36-be0c-c82b14325f8a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:51.421103 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7399f90d-3da8-4f36-be0c-c82b14325f8a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:51.421866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7399f90d-3da8-4f36-be0c-c82b14325f8a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:51.422970 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7399f90d-3da8-4f36-be0c-c82b14325f8a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:51.423440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7399f90d-3da8-4f36-be0c-c82b14325f8a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:51.443244 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-525f086c-285d-4829-a0bf-63a9ea089cfb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:51.444301 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-525f086c-285d-4829-a0bf-63a9ea089cfb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:51.449237 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=100 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:58:51.473777 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-525f086c-285d-4829-a0bf-63a9ea089cfb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:51.478404 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-525f086c-285d-4829-a0bf-63a9ea089cfb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:51.481621 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-525f086c-285d-4829-a0bf-63a9ea089cfb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:51.482392 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-525f086c-285d-4829-a0bf-63a9ea089cfb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:51.485183 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-525f086c-285d-4829-a0bf-63a9ea089cfb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:51.485572 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-525f086c-285d-4829-a0bf-63a9ea089cfb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:51.601595 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-7399f90d-3da8-4f36-be0c-c82b14325f8a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.217057 Sep 09 12:58:51.602533 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 113/231] 10.222.0.46 () {58 vars in 1275 bytes} [Fri Sep 9 12:58:51 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb/os-interface => generated 284 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:58:51.708602 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a7a957c4-c50d-4d8d-aa5d-ab9ec0aa047b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:51.709232 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-a7a957c4-c50d-4d8d-aa5d-ab9ec0aa047b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:51.724687 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a7a957c4-c50d-4d8d-aa5d-ab9ec0aa047b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:51.730007 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a7a957c4-c50d-4d8d-aa5d-ab9ec0aa047b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:51.730993 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a7a957c4-c50d-4d8d-aa5d-ab9ec0aa047b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:51.734108 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a7a957c4-c50d-4d8d-aa5d-ab9ec0aa047b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:51.737635 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a7a957c4-c50d-4d8d-aa5d-ab9ec0aa047b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:51.739942 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a7a957c4-c50d-4d8d-aa5d-ab9ec0aa047b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:51.763050 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-525f086c-285d-4829-a0bf-63a9ea089cfb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:51.778530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-525f086c-285d-4829-a0bf-63a9ea089cfb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.338322 Sep 09 12:58:51.779499 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 119/232] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:51 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:58:52.216934 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-a7a957c4-c50d-4d8d-aa5d-ab9ec0aa047b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:52.232583 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-a7a957c4-c50d-4d8d-aa5d-ab9ec0aa047b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:52.234844 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-a7a957c4-c50d-4d8d-aa5d-ab9ec0aa047b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:52.236370 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-a7a957c4-c50d-4d8d-aa5d-ab9ec0aa047b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1739 microversion: 2.20 time: 0.532244 Sep 09 12:58:52.261657 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 114/233] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:51 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1739 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:58:52.812858 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-31ddfdf3-0c84-4312-842f-c26fd8c2a03c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:52.814266 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-31ddfdf3-0c84-4312-842f-c26fd8c2a03c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:52.822724 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-31ddfdf3-0c84-4312-842f-c26fd8c2a03c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:52.823561 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-31ddfdf3-0c84-4312-842f-c26fd8c2a03c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:52.824154 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-31ddfdf3-0c84-4312-842f-c26fd8c2a03c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:52.824934 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-31ddfdf3-0c84-4312-842f-c26fd8c2a03c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:52.825583 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-31ddfdf3-0c84-4312-842f-c26fd8c2a03c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:52.826382 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-31ddfdf3-0c84-4312-842f-c26fd8c2a03c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:53.032318 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-31ddfdf3-0c84-4312-842f-c26fd8c2a03c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:53.047656 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-31ddfdf3-0c84-4312-842f-c26fd8c2a03c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.247881 Sep 09 12:58:53.048750 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 120/234] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:52 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:53.270095 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-d4c880a9-f66b-4c09-bbfc-1cd016904ba0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:53.270840 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-d4c880a9-f66b-4c09-bbfc-1cd016904ba0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:53.281367 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=72 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:58:53.282897 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d4c880a9-f66b-4c09-bbfc-1cd016904ba0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:53.283389 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d4c880a9-f66b-4c09-bbfc-1cd016904ba0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:53.286773 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d4c880a9-f66b-4c09-bbfc-1cd016904ba0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:53.288489 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d4c880a9-f66b-4c09-bbfc-1cd016904ba0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:53.289489 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d4c880a9-f66b-4c09-bbfc-1cd016904ba0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:53.290140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d4c880a9-f66b-4c09-bbfc-1cd016904ba0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:53.466773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-51555519-b8bd-4319-9cec-63950cb53fdd tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Action: 'create', calling method: .version_select at 0x7f31831c8af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1884139847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJbwyhm83S43bBKnkGTVpZiJpyBUZVfBnCk5Hzown232oumGB9Iwv+zhtMEF0GVb+RP/1eV0djH/p/hmhkByfTPZr50kjQU/yrj3MLZzJVdQE2//Xo0bDb4ioJqY+2rmw=="}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:58:53.509177 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-51555519-b8bd-4319-9cec-63950cb53fdd tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Getting quotas for project d427be7da6084e009b87ff500858cdc8. Resources: {'key_pairs'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:58:53.520269 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-51555519-b8bd-4319-9cec-63950cb53fdd tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Getting quotas for user 4c96322c48c146c7b8bcb9959f533820 and project d427be7da6084e009b87ff500858cdc8. Resources: {'key_pairs'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:58:53.523545 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:58:53.568323 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-d4c880a9-f66b-4c09-bbfc-1cd016904ba0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:53.584342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-d4c880a9-f66b-4c09-bbfc-1cd016904ba0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:53.589774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-d4c880a9-f66b-4c09-bbfc-1cd016904ba0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:53.593213 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-d4c880a9-f66b-4c09-bbfc-1cd016904ba0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1739 microversion: 2.20 time: 0.327620 Sep 09 12:58:53.610507 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 121/235] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:53 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1739 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:58:53.615043 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-0ab8fb35-4859-469d-b44c-a00704d9894a req-baec0944-3fd4-4e6b-b8c4-0e4881e7b2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1da39a54-b8f3-49a7-9447-497fadd2cefb", "tag": "e5f34505-ba7c-40ff-b43f-cf15fb7702b3"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:58:53.641255 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-0ab8fb35-4859-469d-b44c-a00704d9894a req-baec0944-3fd4-4e6b-b8c4-0e4881e7b2d3 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:53.642407 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-0ab8fb35-4859-469d-b44c-a00704d9894a req-baec0944-3fd4-4e6b-b8c4-0e4881e7b2d3 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:53.643121 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-0ab8fb35-4859-469d-b44c-a00704d9894a req-baec0944-3fd4-4e6b-b8c4-0e4881e7b2d3 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:53.658094 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-51555519-b8bd-4319-9cec-63950cb53fdd tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.501985 Sep 09 12:58:53.659022 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 115/236] 10.222.0.46 () {60 vars in 1159 bytes} [Fri Sep 9 12:58:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:58:53.660963 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-0ab8fb35-4859-469d-b44c-a00704d9894a req-baec0944-3fd4-4e6b-b8c4-0e4881e7b2d3 service nova] Creating event network-changed:e5f34505-ba7c-40ff-b43f-cf15fb7702b3 for instance 1da39a54-b8f3-49a7-9447-497fadd2cefb on hv-cinder-81322 Sep 09 12:58:53.669229 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-0ab8fb35-4859-469d-b44c-a00704d9894a req-baec0944-3fd4-4e6b-b8c4-0e4881e7b2d3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065189 Sep 09 12:58:53.670976 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 122/237] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:58:54.073967 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-bdbd0c75-d870-41c0-a33e-bb6df3d1b6fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:54.075063 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-bdbd0c75-d870-41c0-a33e-bb6df3d1b6fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:54.091891 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bdbd0c75-d870-41c0-a33e-bb6df3d1b6fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:54.094322 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bdbd0c75-d870-41c0-a33e-bb6df3d1b6fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:54.094981 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bdbd0c75-d870-41c0-a33e-bb6df3d1b6fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:54.099889 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bdbd0c75-d870-41c0-a33e-bb6df3d1b6fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:54.099889 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bdbd0c75-d870-41c0-a33e-bb6df3d1b6fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:54.099889 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bdbd0c75-d870-41c0-a33e-bb6df3d1b6fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:54.441913 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-bdbd0c75-d870-41c0-a33e-bb6df3d1b6fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:54.450758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-bdbd0c75-d870-41c0-a33e-bb6df3d1b6fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.381250 Sep 09 12:58:54.455485 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 116/238] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:54 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:54.625150 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-573271d1-30f7-47ed-8860-a3a43208afa6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:54.631369 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-573271d1-30f7-47ed-8860-a3a43208afa6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:54.656720 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-573271d1-30f7-47ed-8860-a3a43208afa6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:54.657390 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-573271d1-30f7-47ed-8860-a3a43208afa6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:54.661219 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-573271d1-30f7-47ed-8860-a3a43208afa6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:54.661219 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-573271d1-30f7-47ed-8860-a3a43208afa6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:54.661219 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-573271d1-30f7-47ed-8860-a3a43208afa6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:54.666460 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-573271d1-30f7-47ed-8860-a3a43208afa6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:54.857539 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-573271d1-30f7-47ed-8860-a3a43208afa6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:54.869133 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-573271d1-30f7-47ed-8860-a3a43208afa6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:54.871547 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-573271d1-30f7-47ed-8860-a3a43208afa6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:54.872876 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-573271d1-30f7-47ed-8860-a3a43208afa6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1739 microversion: 2.20 time: 0.251963 Sep 09 12:58:54.873900 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 123/239] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:54 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:55.485033 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-7e56e1a6-bf0b-4b70-bb4f-ba9e36aad076 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:55.485689 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-7e56e1a6-bf0b-4b70-bb4f-ba9e36aad076 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:55.493700 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7e56e1a6-bf0b-4b70-bb4f-ba9e36aad076 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:55.494259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7e56e1a6-bf0b-4b70-bb4f-ba9e36aad076 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:55.494740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7e56e1a6-bf0b-4b70-bb4f-ba9e36aad076 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:55.495497 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7e56e1a6-bf0b-4b70-bb4f-ba9e36aad076 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:55.495964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7e56e1a6-bf0b-4b70-bb4f-ba9e36aad076 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:55.496402 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7e56e1a6-bf0b-4b70-bb4f-ba9e36aad076 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:55.885973 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-7e56e1a6-bf0b-4b70-bb4f-ba9e36aad076 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:55.900886 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-5bc921bf-56f1-463b-8602-e03c339ccb8a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:55.902204 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-7e56e1a6-bf0b-4b70-bb4f-ba9e36aad076 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.421564 Sep 09 12:58:55.902863 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 117/240] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:55 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:55.903964 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-5bc921bf-56f1-463b-8602-e03c339ccb8a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:55.911897 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5bc921bf-56f1-463b-8602-e03c339ccb8a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:55.912508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5bc921bf-56f1-463b-8602-e03c339ccb8a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:55.913036 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5bc921bf-56f1-463b-8602-e03c339ccb8a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:55.913820 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5bc921bf-56f1-463b-8602-e03c339ccb8a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:55.914352 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5bc921bf-56f1-463b-8602-e03c339ccb8a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:55.914880 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5bc921bf-56f1-463b-8602-e03c339ccb8a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:56.072463 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-5bc921bf-56f1-463b-8602-e03c339ccb8a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:56.081850 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-5bc921bf-56f1-463b-8602-e03c339ccb8a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:56.083338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-5bc921bf-56f1-463b-8602-e03c339ccb8a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:56.084506 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-5bc921bf-56f1-463b-8602-e03c339ccb8a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1739 microversion: 2.20 time: 0.188240 Sep 09 12:58:56.085067 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 124/241] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:55 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:56.925186 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d3aad507-de52-428b-b760-d51917bc8539 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:56.925837 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-d3aad507-de52-428b-b760-d51917bc8539 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:56.933386 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d3aad507-de52-428b-b760-d51917bc8539 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:56.934106 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d3aad507-de52-428b-b760-d51917bc8539 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:56.934582 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d3aad507-de52-428b-b760-d51917bc8539 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:56.935315 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d3aad507-de52-428b-b760-d51917bc8539 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:56.935768 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d3aad507-de52-428b-b760-d51917bc8539 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:56.936196 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d3aad507-de52-428b-b760-d51917bc8539 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:57.087211 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-d3aad507-de52-428b-b760-d51917bc8539 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:57.098981 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d3aad507-de52-428b-b760-d51917bc8539 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.177569 Sep 09 12:58:57.100760 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 118/242] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:56 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:57.112314 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e0eeea98-f783-4b6a-87b4-bd0fe1598965 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:57.113612 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e0eeea98-f783-4b6a-87b4-bd0fe1598965 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:57.121187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e0eeea98-f783-4b6a-87b4-bd0fe1598965 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:57.121681 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e0eeea98-f783-4b6a-87b4-bd0fe1598965 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:57.122111 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e0eeea98-f783-4b6a-87b4-bd0fe1598965 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:57.123019 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e0eeea98-f783-4b6a-87b4-bd0fe1598965 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:57.123475 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e0eeea98-f783-4b6a-87b4-bd0fe1598965 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:57.123905 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e0eeea98-f783-4b6a-87b4-bd0fe1598965 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:57.301009 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e0eeea98-f783-4b6a-87b4-bd0fe1598965 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:57.315253 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e0eeea98-f783-4b6a-87b4-bd0fe1598965 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:57.316987 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e0eeea98-f783-4b6a-87b4-bd0fe1598965 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:57.320034 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e0eeea98-f783-4b6a-87b4-bd0fe1598965 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1739 microversion: 2.20 time: 0.212326 Sep 09 12:58:57.336788 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 125/243] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:57 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:58.123799 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-841467ec-6c9d-45a9-be07-afaae799bf19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:58.124551 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-841467ec-6c9d-45a9-be07-afaae799bf19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:58.132994 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-841467ec-6c9d-45a9-be07-afaae799bf19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:58.133660 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-841467ec-6c9d-45a9-be07-afaae799bf19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:58.134157 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-841467ec-6c9d-45a9-be07-afaae799bf19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:58.135439 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-841467ec-6c9d-45a9-be07-afaae799bf19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:58.138554 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-841467ec-6c9d-45a9-be07-afaae799bf19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:58.138554 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-841467ec-6c9d-45a9-be07-afaae799bf19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:58.281687 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-841467ec-6c9d-45a9-be07-afaae799bf19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:58.289552 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-841467ec-6c9d-45a9-be07-afaae799bf19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.172184 Sep 09 12:58:58.290658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 119/244] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:58 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:58.349830 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c6fcecc8-07a7-4d66-b27e-e2830ce021b5 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:58.350470 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-c6fcecc8-07a7-4d66-b27e-e2830ce021b5 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:58.357624 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c6fcecc8-07a7-4d66-b27e-e2830ce021b5 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:58.357820 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c6fcecc8-07a7-4d66-b27e-e2830ce021b5 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:58.359257 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c6fcecc8-07a7-4d66-b27e-e2830ce021b5 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:58.359974 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c6fcecc8-07a7-4d66-b27e-e2830ce021b5 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:58.360438 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c6fcecc8-07a7-4d66-b27e-e2830ce021b5 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:58.360899 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c6fcecc8-07a7-4d66-b27e-e2830ce021b5 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:58.565278 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c6fcecc8-07a7-4d66-b27e-e2830ce021b5 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:58.574815 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c6fcecc8-07a7-4d66-b27e-e2830ce021b5 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:58.576358 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c6fcecc8-07a7-4d66-b27e-e2830ce021b5 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:58.577544 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-c6fcecc8-07a7-4d66-b27e-e2830ce021b5 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1721 microversion: 2.20 time: 0.232055 Sep 09 12:58:58.578133 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 126/245] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:58 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:58:59.313046 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ade2c835-0615-469b-adce-927e5ac59353 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:59.314272 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ade2c835-0615-469b-adce-927e5ac59353 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:59.320823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ade2c835-0615-469b-adce-927e5ac59353 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:59.321322 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ade2c835-0615-469b-adce-927e5ac59353 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:59.322575 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ade2c835-0615-469b-adce-927e5ac59353 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:59.323285 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ade2c835-0615-469b-adce-927e5ac59353 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:59.323745 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ade2c835-0615-469b-adce-927e5ac59353 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:59.324822 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ade2c835-0615-469b-adce-927e5ac59353 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:59.466959 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ade2c835-0615-469b-adce-927e5ac59353 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:59.474696 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ade2c835-0615-469b-adce-927e5ac59353 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.165627 Sep 09 12:58:59.475251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 120/246] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:58:59 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:58:59.604699 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-9fa18a34-35ab-49f9-9551-b3f348699678 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:58:59.605303 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-9fa18a34-35ab-49f9-9551-b3f348699678 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:58:59.611769 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9fa18a34-35ab-49f9-9551-b3f348699678 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:59.612278 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9fa18a34-35ab-49f9-9551-b3f348699678 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:59.612723 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9fa18a34-35ab-49f9-9551-b3f348699678 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:59.613418 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9fa18a34-35ab-49f9-9551-b3f348699678 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:58:59.613882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9fa18a34-35ab-49f9-9551-b3f348699678 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:58:59.614311 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9fa18a34-35ab-49f9-9551-b3f348699678 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:58:59.756282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-9fa18a34-35ab-49f9-9551-b3f348699678 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:59.764584 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-9fa18a34-35ab-49f9-9551-b3f348699678 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:59.766009 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-9fa18a34-35ab-49f9-9551-b3f348699678 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:58:59.767381 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-9fa18a34-35ab-49f9-9551-b3f348699678 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1721 microversion: 2.20 time: 0.167127 Sep 09 12:58:59.767933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 127/247] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:58:59 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:00.497911 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e03d19db-4873-40ab-9e88-0ae6fa3e201a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:00.498636 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-e03d19db-4873-40ab-9e88-0ae6fa3e201a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:00.505265 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e03d19db-4873-40ab-9e88-0ae6fa3e201a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:00.505748 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e03d19db-4873-40ab-9e88-0ae6fa3e201a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:00.506182 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e03d19db-4873-40ab-9e88-0ae6fa3e201a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:00.506891 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e03d19db-4873-40ab-9e88-0ae6fa3e201a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:00.507341 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e03d19db-4873-40ab-9e88-0ae6fa3e201a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:00.509009 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e03d19db-4873-40ab-9e88-0ae6fa3e201a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:00.779481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e03d19db-4873-40ab-9e88-0ae6fa3e201a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:00.787349 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-e03d19db-4873-40ab-9e88-0ae6fa3e201a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.294198 Sep 09 12:59:00.797429 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 121/248] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:00 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:00.797653 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-95ae047a-4fed-445c-b30a-0c9f0ca39836 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:00.797653 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-95ae047a-4fed-445c-b30a-0c9f0ca39836 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:00.801437 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-95ae047a-4fed-445c-b30a-0c9f0ca39836 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:00.801927 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-95ae047a-4fed-445c-b30a-0c9f0ca39836 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:00.802375 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-95ae047a-4fed-445c-b30a-0c9f0ca39836 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:00.803102 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-95ae047a-4fed-445c-b30a-0c9f0ca39836 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:00.803558 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-95ae047a-4fed-445c-b30a-0c9f0ca39836 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:00.803991 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-95ae047a-4fed-445c-b30a-0c9f0ca39836 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:00.948103 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-95ae047a-4fed-445c-b30a-0c9f0ca39836 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:00.956475 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-95ae047a-4fed-445c-b30a-0c9f0ca39836 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:00.957848 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-95ae047a-4fed-445c-b30a-0c9f0ca39836 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:00.959055 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-95ae047a-4fed-445c-b30a-0c9f0ca39836 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1724 microversion: 2.20 time: 0.170491 Sep 09 12:59:00.959615 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 128/249] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:00 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:00.996079 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-9bc98659-70c9-4c03-bdc9-4b930a823276 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "283eb5dd-fac2-4527-91e3-5ee223fbb869"}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:59:00.998649 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-9bc98659-70c9-4c03-bdc9-4b930a823276 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:01.005011 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9bc98659-70c9-4c03-bdc9-4b930a823276 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:01.005576 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9bc98659-70c9-4c03-bdc9-4b930a823276 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:01.006023 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9bc98659-70c9-4c03-bdc9-4b930a823276 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:01.006738 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9bc98659-70c9-4c03-bdc9-4b930a823276 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:01.007193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9bc98659-70c9-4c03-bdc9-4b930a823276 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:01.007629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9bc98659-70c9-4c03-bdc9-4b930a823276 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:01.777888 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-7e71741d-05d9-4622-80ec-2621ee5246f9 req-b64831ec-ba74-4171-8997-ed3a6e18eb99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78dad9a3-ac85-4014-829c-986cca18c8b1", "name": "network-vif-unplugged", "status": "completed", "tag": "244f1be5-c384-494f-b53f-53fb6f1b2689"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:59:01.787906 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-7e71741d-05d9-4622-80ec-2621ee5246f9 req-b64831ec-ba74-4171-8997-ed3a6e18eb99 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:01.788415 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-7e71741d-05d9-4622-80ec-2621ee5246f9 req-b64831ec-ba74-4171-8997-ed3a6e18eb99 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:01.788904 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-7e71741d-05d9-4622-80ec-2621ee5246f9 req-b64831ec-ba74-4171-8997-ed3a6e18eb99 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:01.802751 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.compute.server_external_events [req-7e71741d-05d9-4622-80ec-2621ee5246f9 req-b64831ec-ba74-4171-8997-ed3a6e18eb99 service nova] Unable to find a host for instance 78dad9a3-ac85-4014-829c-986cca18c8b1. Dropping event network-vif-unplugged {{(pid=127772) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 12:59:01.803666 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-7e71741d-05d9-4622-80ec-2621ee5246f9 req-b64831ec-ba74-4171-8997-ed3a6e18eb99 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036693 Sep 09 12:59:01.805566 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 129/250] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 09 12:59:01.812145 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-5e6a7a27-f2c6-49dd-8505-f6ec72eb3199 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:01.812787 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-5e6a7a27-f2c6-49dd-8505-f6ec72eb3199 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:01.824375 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5e6a7a27-f2c6-49dd-8505-f6ec72eb3199 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:01.824930 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5e6a7a27-f2c6-49dd-8505-f6ec72eb3199 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:01.825375 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5e6a7a27-f2c6-49dd-8505-f6ec72eb3199 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:01.826083 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5e6a7a27-f2c6-49dd-8505-f6ec72eb3199 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:01.826569 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5e6a7a27-f2c6-49dd-8505-f6ec72eb3199 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:01.827001 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5e6a7a27-f2c6-49dd-8505-f6ec72eb3199 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:02.138173 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-9bc98659-70c9-4c03-bdc9-4b930a823276 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "POST /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.147508 Sep 09 12:59:02.139174 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 122/251] 10.222.0.46 () {62 vars in 1364 bytes} [Fri Sep 9 12:59:00 2022] POST /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1/os-volume_attachments => generated 188 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:59:02.229006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-5e6a7a27-f2c6-49dd-8505-f6ec72eb3199 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:02.238962 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-5e6a7a27-f2c6-49dd-8505-f6ec72eb3199 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.429903 Sep 09 12:59:02.259111 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 130/252] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:01 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:02.295704 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-be05fa1f-9adf-4b7e-b21e-c5b480406383 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:59:02.296424 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-be05fa1f-9adf-4b7e-b21e-c5b480406383 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:02.302436 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-be05fa1f-9adf-4b7e-b21e-c5b480406383 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:02.306957 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-be05fa1f-9adf-4b7e-b21e-c5b480406383 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:02.306957 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-be05fa1f-9adf-4b7e-b21e-c5b480406383 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:02.306957 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-be05fa1f-9adf-4b7e-b21e-c5b480406383 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:02.306957 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-be05fa1f-9adf-4b7e-b21e-c5b480406383 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:02.307335 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-be05fa1f-9adf-4b7e-b21e-c5b480406383 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:02.350985 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-be05fa1f-9adf-4b7e-b21e-c5b480406383 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127771) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 12:59:02.649524 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-be05fa1f-9adf-4b7e-b21e-c5b480406383 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "POST /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1/action" status: 202 len: 0 microversion: 2.20 time: 0.357771 Sep 09 12:59:02.650455 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 123/253] 10.222.0.46 () {62 vars in 1319 bytes} [Fri Sep 9 12:59:02 2022] POST /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:59:02.658752 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-16b8ccb5-0db6-4102-842f-c68f6adecca1 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:02.659358 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-16b8ccb5-0db6-4102-842f-c68f6adecca1 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:02.666370 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-16b8ccb5-0db6-4102-842f-c68f6adecca1 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:02.667057 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-16b8ccb5-0db6-4102-842f-c68f6adecca1 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:02.669616 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-16b8ccb5-0db6-4102-842f-c68f6adecca1 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:02.670394 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-16b8ccb5-0db6-4102-842f-c68f6adecca1 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:02.670917 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-16b8ccb5-0db6-4102-842f-c68f6adecca1 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:02.671332 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-16b8ccb5-0db6-4102-842f-c68f6adecca1 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:02.823444 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-16b8ccb5-0db6-4102-842f-c68f6adecca1 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:02.833146 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-16b8ccb5-0db6-4102-842f-c68f6adecca1 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:02.834692 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-16b8ccb5-0db6-4102-842f-c68f6adecca1 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:02.835890 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-16b8ccb5-0db6-4102-842f-c68f6adecca1 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1750 microversion: 2.20 time: 0.181266 Sep 09 12:59:02.836453 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 131/254] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:02 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1750 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:59:03.265911 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-158f44f4-edbf-4d9b-a39a-e93c632eef1f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:03.266548 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-158f44f4-edbf-4d9b-a39a-e93c632eef1f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:03.272676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-158f44f4-edbf-4d9b-a39a-e93c632eef1f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:03.273375 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-158f44f4-edbf-4d9b-a39a-e93c632eef1f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:03.273845 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-158f44f4-edbf-4d9b-a39a-e93c632eef1f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:03.274638 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-158f44f4-edbf-4d9b-a39a-e93c632eef1f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:03.275337 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-158f44f4-edbf-4d9b-a39a-e93c632eef1f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:03.275893 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-158f44f4-edbf-4d9b-a39a-e93c632eef1f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:03.433294 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-158f44f4-edbf-4d9b-a39a-e93c632eef1f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:03.443813 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-158f44f4-edbf-4d9b-a39a-e93c632eef1f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.181761 Sep 09 12:59:03.444400 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 124/255] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:03 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:03.869278 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c37477a0-1847-4b7b-b106-99a4fdd07b9b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:03.871467 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-c37477a0-1847-4b7b-b106-99a4fdd07b9b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:03.876839 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c37477a0-1847-4b7b-b106-99a4fdd07b9b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:03.877423 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c37477a0-1847-4b7b-b106-99a4fdd07b9b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:03.878062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c37477a0-1847-4b7b-b106-99a4fdd07b9b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:03.878802 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c37477a0-1847-4b7b-b106-99a4fdd07b9b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:03.879263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c37477a0-1847-4b7b-b106-99a4fdd07b9b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:03.879689 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c37477a0-1847-4b7b-b106-99a4fdd07b9b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:04.102832 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c37477a0-1847-4b7b-b106-99a4fdd07b9b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:04.114236 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c37477a0-1847-4b7b-b106-99a4fdd07b9b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:04.116104 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c37477a0-1847-4b7b-b106-99a4fdd07b9b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:04.117260 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-c37477a0-1847-4b7b-b106-99a4fdd07b9b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1750 microversion: 2.20 time: 0.253999 Sep 09 12:59:04.117814 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 132/256] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:03 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1750 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:04.464630 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=4 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:04.470989 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-9e0dcf9b-5394-4615-8b5b-4ef92bf072ea tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:04.476282 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-9e0dcf9b-5394-4615-8b5b-4ef92bf072ea tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:04.481581 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9e0dcf9b-5394-4615-8b5b-4ef92bf072ea tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:04.482575 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9e0dcf9b-5394-4615-8b5b-4ef92bf072ea tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:04.483058 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9e0dcf9b-5394-4615-8b5b-4ef92bf072ea tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:04.484112 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9e0dcf9b-5394-4615-8b5b-4ef92bf072ea tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:04.485127 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9e0dcf9b-5394-4615-8b5b-4ef92bf072ea tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:04.485600 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9e0dcf9b-5394-4615-8b5b-4ef92bf072ea tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:04.651728 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-9e0dcf9b-5394-4615-8b5b-4ef92bf072ea tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:04.659509 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-9e0dcf9b-5394-4615-8b5b-4ef92bf072ea tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1522 microversion: 2.1 time: 0.196385 Sep 09 12:59:04.660061 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 125/257] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:04 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:05.151049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7f828c3e-e01f-44a6-9392-382414f89a60 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:05.151838 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7f828c3e-e01f-44a6-9392-382414f89a60 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:05.158099 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7f828c3e-e01f-44a6-9392-382414f89a60 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:05.158636 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7f828c3e-e01f-44a6-9392-382414f89a60 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:05.159103 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7f828c3e-e01f-44a6-9392-382414f89a60 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:05.159943 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7f828c3e-e01f-44a6-9392-382414f89a60 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:05.160406 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7f828c3e-e01f-44a6-9392-382414f89a60 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:05.161175 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7f828c3e-e01f-44a6-9392-382414f89a60 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:05.305020 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7f828c3e-e01f-44a6-9392-382414f89a60 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:05.314585 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7f828c3e-e01f-44a6-9392-382414f89a60 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:05.316046 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7f828c3e-e01f-44a6-9392-382414f89a60 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:05.317209 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7f828c3e-e01f-44a6-9392-382414f89a60 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1752 microversion: 2.20 time: 0.170976 Sep 09 12:59:05.317938 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 133/258] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:05 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:05.682511 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-4c7d12f9-cbfb-4d0c-a3cf-71ca07150812 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:05.683136 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-4c7d12f9-cbfb-4d0c-a3cf-71ca07150812 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:05.689633 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4c7d12f9-cbfb-4d0c-a3cf-71ca07150812 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:05.693947 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4c7d12f9-cbfb-4d0c-a3cf-71ca07150812 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:05.693947 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4c7d12f9-cbfb-4d0c-a3cf-71ca07150812 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:05.693947 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4c7d12f9-cbfb-4d0c-a3cf-71ca07150812 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:05.693947 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4c7d12f9-cbfb-4d0c-a3cf-71ca07150812 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:05.694383 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4c7d12f9-cbfb-4d0c-a3cf-71ca07150812 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:05.946995 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-4c7d12f9-cbfb-4d0c-a3cf-71ca07150812 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:05.955050 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-4c7d12f9-cbfb-4d0c-a3cf-71ca07150812 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1502 microversion: 2.1 time: 0.276957 Sep 09 12:59:05.955628 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 126/259] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:05 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1502 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:05.985046 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a6a4edc3-d134-4176-b658-5a578e78be4e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:05.985595 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a6a4edc3-d134-4176-b658-5a578e78be4e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:05.991720 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a6a4edc3-d134-4176-b658-5a578e78be4e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:05.992200 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a6a4edc3-d134-4176-b658-5a578e78be4e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:05.992634 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a6a4edc3-d134-4176-b658-5a578e78be4e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:05.993355 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a6a4edc3-d134-4176-b658-5a578e78be4e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:05.993872 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a6a4edc3-d134-4176-b658-5a578e78be4e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:05.994303 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a6a4edc3-d134-4176-b658-5a578e78be4e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:06.014918 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=100 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:06.152906 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a6a4edc3-d134-4176-b658-5a578e78be4e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:06.162334 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a6a4edc3-d134-4176-b658-5a578e78be4e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1514 microversion: 2.1 time: 0.181211 Sep 09 12:59:06.162966 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 134/260] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:05 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:06.344279 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-4092a35a-8a20-412a-bc0f-a5ca5f5def3a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:06.345327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-4092a35a-8a20-412a-bc0f-a5ca5f5def3a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:06.352233 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4092a35a-8a20-412a-bc0f-a5ca5f5def3a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:06.354345 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4092a35a-8a20-412a-bc0f-a5ca5f5def3a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:06.355308 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4092a35a-8a20-412a-bc0f-a5ca5f5def3a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:06.356453 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4092a35a-8a20-412a-bc0f-a5ca5f5def3a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:06.357175 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4092a35a-8a20-412a-bc0f-a5ca5f5def3a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:06.357951 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4092a35a-8a20-412a-bc0f-a5ca5f5def3a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:06.383570 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:06.593960 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-4092a35a-8a20-412a-bc0f-a5ca5f5def3a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:06.604172 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-4092a35a-8a20-412a-bc0f-a5ca5f5def3a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:06.605857 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-4092a35a-8a20-412a-bc0f-a5ca5f5def3a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:06.607169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-4092a35a-8a20-412a-bc0f-a5ca5f5def3a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1752 microversion: 2.20 time: 0.266789 Sep 09 12:59:06.617763 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 127/261] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:06 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1752 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:07.637880 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ccd7da3d-c061-4a9d-a3db-2d87b26f2871 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:07.639452 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-ccd7da3d-c061-4a9d-a3db-2d87b26f2871 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:07.645979 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ccd7da3d-c061-4a9d-a3db-2d87b26f2871 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:07.646872 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ccd7da3d-c061-4a9d-a3db-2d87b26f2871 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:07.647567 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ccd7da3d-c061-4a9d-a3db-2d87b26f2871 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:07.648497 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ccd7da3d-c061-4a9d-a3db-2d87b26f2871 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:07.649950 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ccd7da3d-c061-4a9d-a3db-2d87b26f2871 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:07.651447 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ccd7da3d-c061-4a9d-a3db-2d87b26f2871 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:07.899160 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ccd7da3d-c061-4a9d-a3db-2d87b26f2871 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:07.912442 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ccd7da3d-c061-4a9d-a3db-2d87b26f2871 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:07.917906 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ccd7da3d-c061-4a9d-a3db-2d87b26f2871 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:07.920223 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-ccd7da3d-c061-4a9d-a3db-2d87b26f2871 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.288669 Sep 09 12:59:07.922163 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 135/262] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:07 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:08.059701 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ac2aebb8-0375-4756-a028-dc6243d7b881 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:59:08.062829 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ac2aebb8-0375-4756-a028-dc6243d7b881 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:08.069747 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ac2aebb8-0375-4756-a028-dc6243d7b881 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:08.070570 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ac2aebb8-0375-4756-a028-dc6243d7b881 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:08.072066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ac2aebb8-0375-4756-a028-dc6243d7b881 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:08.073026 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ac2aebb8-0375-4756-a028-dc6243d7b881 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:08.073721 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ac2aebb8-0375-4756-a028-dc6243d7b881 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:08.074360 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ac2aebb8-0375-4756-a028-dc6243d7b881 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:08.103767 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.objects.instance [None req-ac2aebb8-0375-4756-a028-dc6243d7b881 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lazy-loading 'flavor' on Instance uuid 6d440fb7-9e24-433c-9cc5-282005be09bb {{(pid=127771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:59:08.464097 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ac2aebb8-0375-4756-a028-dc6243d7b881 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "POST /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb/action" status: 200 len: 32 microversion: 2.1 time: 0.408636 Sep 09 12:59:08.464904 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 128/263] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 12:59:08 2022] POST /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb/action => generated 32 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 12:59:08.482020 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-6920e397-7686-4d59-a4c9-75a16d6f53a6 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:08.482148 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-6920e397-7686-4d59-a4c9-75a16d6f53a6 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:08.491075 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6920e397-7686-4d59-a4c9-75a16d6f53a6 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:08.492276 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6920e397-7686-4d59-a4c9-75a16d6f53a6 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:08.492867 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6920e397-7686-4d59-a4c9-75a16d6f53a6 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:08.494300 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6920e397-7686-4d59-a4c9-75a16d6f53a6 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:08.494963 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6920e397-7686-4d59-a4c9-75a16d6f53a6 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:08.495393 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6920e397-7686-4d59-a4c9-75a16d6f53a6 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:08.689806 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-6920e397-7686-4d59-a4c9-75a16d6f53a6 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:08.698049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-6920e397-7686-4d59-a4c9-75a16d6f53a6 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.220392 Sep 09 12:59:08.713853 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 136/264] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:08 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:08.949042 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d76cd7b8-5d2f-4645-af49-a3360b5d09c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:08.949770 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-d76cd7b8-5d2f-4645-af49-a3360b5d09c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:08.970079 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d76cd7b8-5d2f-4645-af49-a3360b5d09c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:08.970634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d76cd7b8-5d2f-4645-af49-a3360b5d09c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:08.971171 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d76cd7b8-5d2f-4645-af49-a3360b5d09c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:08.971898 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d76cd7b8-5d2f-4645-af49-a3360b5d09c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:08.972360 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d76cd7b8-5d2f-4645-af49-a3360b5d09c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:08.972792 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d76cd7b8-5d2f-4645-af49-a3360b5d09c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:09.269765 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-d76cd7b8-5d2f-4645-af49-a3360b5d09c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:09.291620 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-d76cd7b8-5d2f-4645-af49-a3360b5d09c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:09.293632 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-d76cd7b8-5d2f-4645-af49-a3360b5d09c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:09.295070 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d76cd7b8-5d2f-4645-af49-a3360b5d09c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.351528 Sep 09 12:59:09.313738 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 129/265] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:08 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:09.721340 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-bf06e8ef-c702-4f27-a7b7-c4dea5c0c140 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:09.721964 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-bf06e8ef-c702-4f27-a7b7-c4dea5c0c140 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:09.730794 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bf06e8ef-c702-4f27-a7b7-c4dea5c0c140 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:09.731735 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bf06e8ef-c702-4f27-a7b7-c4dea5c0c140 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:09.733214 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bf06e8ef-c702-4f27-a7b7-c4dea5c0c140 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:09.734299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bf06e8ef-c702-4f27-a7b7-c4dea5c0c140 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:09.735228 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bf06e8ef-c702-4f27-a7b7-c4dea5c0c140 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:09.735897 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bf06e8ef-c702-4f27-a7b7-c4dea5c0c140 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:10.325388 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-47fb93be-1444-4c91-b724-4b1cd2e53cd0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:10.326693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-47fb93be-1444-4c91-b724-4b1cd2e53cd0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:10.348284 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47fb93be-1444-4c91-b724-4b1cd2e53cd0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:10.349036 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47fb93be-1444-4c91-b724-4b1cd2e53cd0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:10.349685 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47fb93be-1444-4c91-b724-4b1cd2e53cd0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:10.350655 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47fb93be-1444-4c91-b724-4b1cd2e53cd0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:10.351357 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47fb93be-1444-4c91-b724-4b1cd2e53cd0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:10.351898 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47fb93be-1444-4c91-b724-4b1cd2e53cd0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:10.361218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-bf06e8ef-c702-4f27-a7b7-c4dea5c0c140 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:10.371167 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-bf06e8ef-c702-4f27-a7b7-c4dea5c0c140 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.653665 Sep 09 12:59:10.381854 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 137/266] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:09 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:10.572359 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-47fb93be-1444-4c91-b724-4b1cd2e53cd0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:10.582009 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-47fb93be-1444-4c91-b724-4b1cd2e53cd0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:10.583770 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-47fb93be-1444-4c91-b724-4b1cd2e53cd0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:10.585167 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-47fb93be-1444-4c91-b724-4b1cd2e53cd0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.264957 Sep 09 12:59:10.586199 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 130/267] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:10 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:59:11.396890 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ec428f7d-8b3a-4a7c-9820-f290ada6c042 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:11.397425 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-ec428f7d-8b3a-4a7c-9820-f290ada6c042 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:11.407055 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ec428f7d-8b3a-4a7c-9820-f290ada6c042 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:11.414210 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ec428f7d-8b3a-4a7c-9820-f290ada6c042 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:11.414210 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ec428f7d-8b3a-4a7c-9820-f290ada6c042 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:11.414210 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ec428f7d-8b3a-4a7c-9820-f290ada6c042 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:11.414210 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ec428f7d-8b3a-4a7c-9820-f290ada6c042 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:11.416835 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ec428f7d-8b3a-4a7c-9820-f290ada6c042 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:11.615650 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-7edd7e2e-63b2-4865-8b01-74b0164aab20 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:11.617586 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-7edd7e2e-63b2-4865-8b01-74b0164aab20 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:11.643476 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7edd7e2e-63b2-4865-8b01-74b0164aab20 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:11.644188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7edd7e2e-63b2-4865-8b01-74b0164aab20 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:11.644723 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7edd7e2e-63b2-4865-8b01-74b0164aab20 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:11.645538 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7edd7e2e-63b2-4865-8b01-74b0164aab20 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:11.646065 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7edd7e2e-63b2-4865-8b01-74b0164aab20 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:11.646611 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7edd7e2e-63b2-4865-8b01-74b0164aab20 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:11.721757 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ec428f7d-8b3a-4a7c-9820-f290ada6c042 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:11.721757 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-ec428f7d-8b3a-4a7c-9820-f290ada6c042 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.291060 Sep 09 12:59:11.721757 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 138/268] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:11 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:11.809574 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-7edd7e2e-63b2-4865-8b01-74b0164aab20 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:11.819140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-7edd7e2e-63b2-4865-8b01-74b0164aab20 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:11.821125 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-7edd7e2e-63b2-4865-8b01-74b0164aab20 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:11.822334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-7edd7e2e-63b2-4865-8b01-74b0164aab20 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.211152 Sep 09 12:59:11.823116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 131/269] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:11 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:12.717168 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-0a05444b-30a3-4802-9ebb-9a941773ca4a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:12.717808 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-0a05444b-30a3-4802-9ebb-9a941773ca4a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:12.743902 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0a05444b-30a3-4802-9ebb-9a941773ca4a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:12.744398 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0a05444b-30a3-4802-9ebb-9a941773ca4a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:12.744836 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0a05444b-30a3-4802-9ebb-9a941773ca4a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:12.745533 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0a05444b-30a3-4802-9ebb-9a941773ca4a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:12.746161 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0a05444b-30a3-4802-9ebb-9a941773ca4a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:12.746612 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0a05444b-30a3-4802-9ebb-9a941773ca4a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:12.856432 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-bf0051eb-2e60-45f2-a35a-d1c3b10a508e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:12.857853 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-bf0051eb-2e60-45f2-a35a-d1c3b10a508e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:12.865953 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bf0051eb-2e60-45f2-a35a-d1c3b10a508e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:12.869748 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bf0051eb-2e60-45f2-a35a-d1c3b10a508e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:12.869748 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bf0051eb-2e60-45f2-a35a-d1c3b10a508e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:12.869748 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bf0051eb-2e60-45f2-a35a-d1c3b10a508e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:12.869748 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bf0051eb-2e60-45f2-a35a-d1c3b10a508e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:12.870375 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bf0051eb-2e60-45f2-a35a-d1c3b10a508e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:12.972169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-0a05444b-30a3-4802-9ebb-9a941773ca4a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:12.982167 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-0a05444b-30a3-4802-9ebb-9a941773ca4a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.277359 Sep 09 12:59:12.985645 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 139/270] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:12 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:13.069439 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-bf0051eb-2e60-45f2-a35a-d1c3b10a508e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:13.079449 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-bf0051eb-2e60-45f2-a35a-d1c3b10a508e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:13.093350 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-bf0051eb-2e60-45f2-a35a-d1c3b10a508e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:13.095776 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-bf0051eb-2e60-45f2-a35a-d1c3b10a508e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.250382 Sep 09 12:59:13.116158 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 132/271] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:12 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:59:14.011783 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-39bb084a-7f3e-40fd-9915-7811cb954627 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:14.012623 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-39bb084a-7f3e-40fd-9915-7811cb954627 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:14.025383 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-39bb084a-7f3e-40fd-9915-7811cb954627 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:14.030476 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-39bb084a-7f3e-40fd-9915-7811cb954627 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:14.030476 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-39bb084a-7f3e-40fd-9915-7811cb954627 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:14.031810 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-39bb084a-7f3e-40fd-9915-7811cb954627 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:14.033286 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-39bb084a-7f3e-40fd-9915-7811cb954627 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:14.033974 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-39bb084a-7f3e-40fd-9915-7811cb954627 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:14.129832 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8cbd7aa1-fa7c-464a-8408-d9020461ae3b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:14.130531 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-8cbd7aa1-fa7c-464a-8408-d9020461ae3b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:14.140080 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8cbd7aa1-fa7c-464a-8408-d9020461ae3b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:14.140578 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8cbd7aa1-fa7c-464a-8408-d9020461ae3b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:14.141027 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8cbd7aa1-fa7c-464a-8408-d9020461ae3b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:14.141745 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8cbd7aa1-fa7c-464a-8408-d9020461ae3b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:14.142202 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8cbd7aa1-fa7c-464a-8408-d9020461ae3b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:14.142665 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8cbd7aa1-fa7c-464a-8408-d9020461ae3b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:14.421370 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-8cbd7aa1-fa7c-464a-8408-d9020461ae3b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:14.432328 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-39bb084a-7f3e-40fd-9915-7811cb954627 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:14.435464 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-8cbd7aa1-fa7c-464a-8408-d9020461ae3b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:14.437297 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-8cbd7aa1-fa7c-464a-8408-d9020461ae3b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:14.438775 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-8cbd7aa1-fa7c-464a-8408-d9020461ae3b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.313116 Sep 09 12:59:14.439869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 133/272] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:14 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:14.440365 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-39bb084a-7f3e-40fd-9915-7811cb954627 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.435034 Sep 09 12:59:14.455263 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 140/273] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:14 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:14.670909 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2d7907d4-e45b-4f35-a90b-3481d2ee4be9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-126431701", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1884139847", "security_groups": [{"name": "tempest-secgroup-smoke-2064900932"}], "block_device_mapping_v2": [{"uuid": "68cf983a-c27b-40bd-aba1-594695621de8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bc9bf6c8-7de3-464c-a549-1b7488b07c6e"}]}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:59:14.928295 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.network.neutron [None req-2d7907d4-e45b-4f35-a90b-3481d2ee4be9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] validate_networks() for [('bc9bf6c8-7de3-464c-a549-1b7488b07c6e', None, None, None, None, None)] {{(pid=127771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:59:15.465844 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c2614ea0-39d8-4714-a6a3-ccef03718369 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:15.466635 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-c2614ea0-39d8-4714-a6a3-ccef03718369 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:15.487718 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c2614ea0-39d8-4714-a6a3-ccef03718369 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:15.488562 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c2614ea0-39d8-4714-a6a3-ccef03718369 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:15.489282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c2614ea0-39d8-4714-a6a3-ccef03718369 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:15.490372 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c2614ea0-39d8-4714-a6a3-ccef03718369 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:15.491081 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c2614ea0-39d8-4714-a6a3-ccef03718369 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:15.491811 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c2614ea0-39d8-4714-a6a3-ccef03718369 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:15.923415 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-2d7907d4-e45b-4f35-a90b-3481d2ee4be9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Flavor limits 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:59:15.925129 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-2d7907d4-e45b-4f35-a90b-3481d2ee4be9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Image limits 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:59:15.925974 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-2d7907d4-e45b-4f35-a90b-3481d2ee4be9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Flavor pref 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:59:15.926590 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-2d7907d4-e45b-4f35-a90b-3481d2ee4be9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Image pref 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:59:15.927278 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-2d7907d4-e45b-4f35-a90b-3481d2ee4be9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:59:15.958372 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2d7907d4-e45b-4f35-a90b-3481d2ee4be9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:15.958910 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2d7907d4-e45b-4f35-a90b-3481d2ee4be9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:15.959354 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2d7907d4-e45b-4f35-a90b-3481d2ee4be9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:15.960133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2d7907d4-e45b-4f35-a90b-3481d2ee4be9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:15.960588 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2d7907d4-e45b-4f35-a90b-3481d2ee4be9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:15.961013 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2d7907d4-e45b-4f35-a90b-3481d2ee4be9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:16.019899 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-2d7907d4-e45b-4f35-a90b-3481d2ee4be9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Getting quotas for project d427be7da6084e009b87ff500858cdc8. Resources: {'instances', 'cores', 'ram'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:59:16.029038 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-2d7907d4-e45b-4f35-a90b-3481d2ee4be9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Getting quotas for user 4c96322c48c146c7b8bcb9959f533820 and project d427be7da6084e009b87ff500858cdc8. Resources: {'instances', 'cores', 'ram'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:59:16.171010 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2d7907d4-e45b-4f35-a90b-3481d2ee4be9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Going to run 1 instances... {{(pid=127771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:59:16.173207 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2d7907d4-e45b-4f35-a90b-3481d2ee4be9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68cf983a-c27b-40bd-aba1-594695621de8',volume_size=None,volume_type=None)] {{(pid=127771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:59:16.470953 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c2614ea0-39d8-4714-a6a3-ccef03718369 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:16.483034 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-c2614ea0-39d8-4714-a6a3-ccef03718369 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 1.022676 Sep 09 12:59:16.484402 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 141/274] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:15 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:16.511785 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-5bdd6b95-3815-4ad4-8912-e64c9dad60e4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:16.512905 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-5bdd6b95-3815-4ad4-8912-e64c9dad60e4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:16.520532 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5bdd6b95-3815-4ad4-8912-e64c9dad60e4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:16.521260 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5bdd6b95-3815-4ad4-8912-e64c9dad60e4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:16.521897 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5bdd6b95-3815-4ad4-8912-e64c9dad60e4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:16.523966 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5bdd6b95-3815-4ad4-8912-e64c9dad60e4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:16.525336 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5bdd6b95-3815-4ad4-8912-e64c9dad60e4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:16.526085 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5bdd6b95-3815-4ad4-8912-e64c9dad60e4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:16.748306 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2d7907d4-e45b-4f35-a90b-3481d2ee4be9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.081547 Sep 09 12:59:16.749277 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 134/275] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 12:59:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 2083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 12:59:16.770778 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8af5755b-da0c-4810-8c82-a338021a8eac tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:16.773420 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-8af5755b-da0c-4810-8c82-a338021a8eac tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:16.906591 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-8af5755b-da0c-4810-8c82-a338021a8eac tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:16.913546 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-5bdd6b95-3815-4ad4-8912-e64c9dad60e4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:16.914540 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-8af5755b-da0c-4810-8c82-a338021a8eac tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1094 microversion: 2.1 time: 0.157526 Sep 09 12:59:16.916554 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 135/276] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:16 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1094 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:16.924802 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-5bdd6b95-3815-4ad4-8912-e64c9dad60e4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:16.944432 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-5bdd6b95-3815-4ad4-8912-e64c9dad60e4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:16.947568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-5bdd6b95-3815-4ad4-8912-e64c9dad60e4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.460062 Sep 09 12:59:16.948870 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 142/277] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:16 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:17.505292 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-09ce90a9-7aca-4143-831f-ea99e4a334a6 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:17.506040 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-09ce90a9-7aca-4143-831f-ea99e4a334a6 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:17.513572 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-09ce90a9-7aca-4143-831f-ea99e4a334a6 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:17.518239 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-09ce90a9-7aca-4143-831f-ea99e4a334a6 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:17.518239 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-09ce90a9-7aca-4143-831f-ea99e4a334a6 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:17.518239 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-09ce90a9-7aca-4143-831f-ea99e4a334a6 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:17.518239 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-09ce90a9-7aca-4143-831f-ea99e4a334a6 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:17.518754 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-09ce90a9-7aca-4143-831f-ea99e4a334a6 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:17.691066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-09ce90a9-7aca-4143-831f-ea99e4a334a6 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:17.701060 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-09ce90a9-7aca-4143-831f-ea99e4a334a6 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.199722 Sep 09 12:59:17.702247 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 136/278] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:17 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:17.937485 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-cf899bdb-40f8-4a56-bc82-fc98e58eec03 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:17.938878 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-cf899bdb-40f8-4a56-bc82-fc98e58eec03 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:17.976823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-eb46762f-9dce-4f80-8d65-afabb267c7b9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:17.977724 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-eb46762f-9dce-4f80-8d65-afabb267c7b9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:17.985053 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-eb46762f-9dce-4f80-8d65-afabb267c7b9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:17.985787 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-eb46762f-9dce-4f80-8d65-afabb267c7b9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:17.986416 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-eb46762f-9dce-4f80-8d65-afabb267c7b9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:17.987308 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-eb46762f-9dce-4f80-8d65-afabb267c7b9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:17.988072 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-eb46762f-9dce-4f80-8d65-afabb267c7b9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:17.988661 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-eb46762f-9dce-4f80-8d65-afabb267c7b9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:18.038804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-cf899bdb-40f8-4a56-bc82-fc98e58eec03 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:18.050238 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-cf899bdb-40f8-4a56-bc82-fc98e58eec03 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1094 microversion: 2.1 time: 0.114590 Sep 09 12:59:18.051125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 143/279] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:17 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1094 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:18.264508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-eb46762f-9dce-4f80-8d65-afabb267c7b9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:18.279093 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-eb46762f-9dce-4f80-8d65-afabb267c7b9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:18.280549 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-eb46762f-9dce-4f80-8d65-afabb267c7b9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:18.281971 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-eb46762f-9dce-4f80-8d65-afabb267c7b9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.308945 Sep 09 12:59:18.297423 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 137/280] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:17 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:18.730230 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a01feab1-8afe-4fda-86d6-154a61b81b43 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:18.730820 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a01feab1-8afe-4fda-86d6-154a61b81b43 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:18.736913 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a01feab1-8afe-4fda-86d6-154a61b81b43 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:18.737405 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a01feab1-8afe-4fda-86d6-154a61b81b43 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:18.738023 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a01feab1-8afe-4fda-86d6-154a61b81b43 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:18.739150 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a01feab1-8afe-4fda-86d6-154a61b81b43 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:18.739771 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a01feab1-8afe-4fda-86d6-154a61b81b43 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:18.740271 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a01feab1-8afe-4fda-86d6-154a61b81b43 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:18.990459 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a01feab1-8afe-4fda-86d6-154a61b81b43 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:19.007204 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a01feab1-8afe-4fda-86d6-154a61b81b43 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.279831 Sep 09 12:59:19.017820 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 144/281] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:18 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:19.077922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-3a2a2601-3bd9-4b61-b7eb-7e4f536068e4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:19.081028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-3a2a2601-3bd9-4b61-b7eb-7e4f536068e4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:19.103677 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3a2a2601-3bd9-4b61-b7eb-7e4f536068e4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:19.106829 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3a2a2601-3bd9-4b61-b7eb-7e4f536068e4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:19.107566 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3a2a2601-3bd9-4b61-b7eb-7e4f536068e4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:19.114464 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3a2a2601-3bd9-4b61-b7eb-7e4f536068e4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:19.114464 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3a2a2601-3bd9-4b61-b7eb-7e4f536068e4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:19.114464 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3a2a2601-3bd9-4b61-b7eb-7e4f536068e4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:19.291555 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-3a2a2601-3bd9-4b61-b7eb-7e4f536068e4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:19.300757 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-3a2a2601-3bd9-4b61-b7eb-7e4f536068e4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1144 microversion: 2.1 time: 0.230746 Sep 09 12:59:19.316690 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 138/282] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:19 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1144 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:19.318373 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-6227306f-fb00-4626-b44b-62f424519786 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:19.318373 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-6227306f-fb00-4626-b44b-62f424519786 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:19.328169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6227306f-fb00-4626-b44b-62f424519786 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:19.328672 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6227306f-fb00-4626-b44b-62f424519786 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:19.329360 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6227306f-fb00-4626-b44b-62f424519786 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:19.337427 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6227306f-fb00-4626-b44b-62f424519786 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:19.337793 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6227306f-fb00-4626-b44b-62f424519786 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:19.338323 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6227306f-fb00-4626-b44b-62f424519786 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:19.622205 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-6227306f-fb00-4626-b44b-62f424519786 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:19.632683 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-6227306f-fb00-4626-b44b-62f424519786 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:19.636642 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-6227306f-fb00-4626-b44b-62f424519786 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:19.638896 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-6227306f-fb00-4626-b44b-62f424519786 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.330922 Sep 09 12:59:19.641053 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 145/283] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:19 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:20.045249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-25c904e5-a129-453f-837c-f6171665180e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:20.045862 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-25c904e5-a129-453f-837c-f6171665180e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:20.052696 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-25c904e5-a129-453f-837c-f6171665180e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:20.053563 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-25c904e5-a129-453f-837c-f6171665180e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:20.054382 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-25c904e5-a129-453f-837c-f6171665180e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:20.064959 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-25c904e5-a129-453f-837c-f6171665180e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:20.064959 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-25c904e5-a129-453f-837c-f6171665180e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:20.064959 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-25c904e5-a129-453f-837c-f6171665180e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:20.256586 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-25c904e5-a129-453f-837c-f6171665180e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:20.293286 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-25c904e5-a129-453f-837c-f6171665180e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.252029 Sep 09 12:59:20.300213 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 139/284] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:20 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:20.324700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ac8a2c35-bd13-47f5-94e3-b3ae874a9352 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:20.325755 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-ac8a2c35-bd13-47f5-94e3-b3ae874a9352 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:20.332581 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ac8a2c35-bd13-47f5-94e3-b3ae874a9352 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:20.333156 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ac8a2c35-bd13-47f5-94e3-b3ae874a9352 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:20.333701 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ac8a2c35-bd13-47f5-94e3-b3ae874a9352 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:20.334403 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ac8a2c35-bd13-47f5-94e3-b3ae874a9352 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:20.334925 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ac8a2c35-bd13-47f5-94e3-b3ae874a9352 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:20.335567 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ac8a2c35-bd13-47f5-94e3-b3ae874a9352 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:20.422201 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ac8a2c35-bd13-47f5-94e3-b3ae874a9352 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:20.431635 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-ac8a2c35-bd13-47f5-94e3-b3ae874a9352 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1192 microversion: 2.1 time: 0.110713 Sep 09 12:59:20.432948 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 146/285] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:20 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1192 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:20.667413 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e93ccd39-8448-4b78-93c6-d8f1f268e7a2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:20.668911 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-e93ccd39-8448-4b78-93c6-d8f1f268e7a2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:20.675460 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e93ccd39-8448-4b78-93c6-d8f1f268e7a2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:20.676203 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e93ccd39-8448-4b78-93c6-d8f1f268e7a2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:20.676703 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e93ccd39-8448-4b78-93c6-d8f1f268e7a2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:20.677412 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e93ccd39-8448-4b78-93c6-d8f1f268e7a2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:20.677947 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e93ccd39-8448-4b78-93c6-d8f1f268e7a2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:20.678348 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e93ccd39-8448-4b78-93c6-d8f1f268e7a2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:20.823161 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e93ccd39-8448-4b78-93c6-d8f1f268e7a2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:20.831861 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e93ccd39-8448-4b78-93c6-d8f1f268e7a2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:20.833380 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e93ccd39-8448-4b78-93c6-d8f1f268e7a2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:20.834543 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-e93ccd39-8448-4b78-93c6-d8f1f268e7a2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.172484 Sep 09 12:59:20.835204 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 140/286] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:20 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:21.323203 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a653a6f8-ed9c-4eb5-bf18-9b4d18d43353 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:21.323871 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a653a6f8-ed9c-4eb5-bf18-9b4d18d43353 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:21.339673 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a653a6f8-ed9c-4eb5-bf18-9b4d18d43353 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:21.363371 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a653a6f8-ed9c-4eb5-bf18-9b4d18d43353 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:21.363371 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a653a6f8-ed9c-4eb5-bf18-9b4d18d43353 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:21.363371 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a653a6f8-ed9c-4eb5-bf18-9b4d18d43353 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:21.363371 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a653a6f8-ed9c-4eb5-bf18-9b4d18d43353 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:21.364546 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a653a6f8-ed9c-4eb5-bf18-9b4d18d43353 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:21.457921 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d52468f8-7a17-42c8-b10b-14898c7e911d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:21.459245 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-d52468f8-7a17-42c8-b10b-14898c7e911d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:21.468775 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d52468f8-7a17-42c8-b10b-14898c7e911d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:21.469583 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d52468f8-7a17-42c8-b10b-14898c7e911d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:21.470182 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d52468f8-7a17-42c8-b10b-14898c7e911d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:21.471114 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d52468f8-7a17-42c8-b10b-14898c7e911d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:21.471578 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d52468f8-7a17-42c8-b10b-14898c7e911d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:21.472007 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d52468f8-7a17-42c8-b10b-14898c7e911d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:21.581625 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-d52468f8-7a17-42c8-b10b-14898c7e911d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:21.595019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d52468f8-7a17-42c8-b10b-14898c7e911d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1200 microversion: 2.1 time: 0.143010 Sep 09 12:59:21.595946 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 141/287] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:21 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1200 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:21.651320 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a653a6f8-ed9c-4eb5-bf18-9b4d18d43353 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:21.661564 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a653a6f8-ed9c-4eb5-bf18-9b4d18d43353 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.342613 Sep 09 12:59:21.663260 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 147/288] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:21 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:21.871258 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-5394035e-dec3-419c-b0d4-b89bb5259094 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:21.871890 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-5394035e-dec3-419c-b0d4-b89bb5259094 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:21.885727 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5394035e-dec3-419c-b0d4-b89bb5259094 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:21.891283 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5394035e-dec3-419c-b0d4-b89bb5259094 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:21.891744 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5394035e-dec3-419c-b0d4-b89bb5259094 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:21.892481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5394035e-dec3-419c-b0d4-b89bb5259094 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:21.892936 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5394035e-dec3-419c-b0d4-b89bb5259094 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:21.893362 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5394035e-dec3-419c-b0d4-b89bb5259094 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:22.112650 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-5394035e-dec3-419c-b0d4-b89bb5259094 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:22.131380 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-5394035e-dec3-419c-b0d4-b89bb5259094 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:22.133145 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-5394035e-dec3-419c-b0d4-b89bb5259094 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:22.135941 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-5394035e-dec3-419c-b0d4-b89bb5259094 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.270372 Sep 09 12:59:22.137985 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 142/289] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:21 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:22.637120 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-87012e37-b841-4296-a004-612e0a35be3c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:22.637971 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-87012e37-b841-4296-a004-612e0a35be3c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:22.654855 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-87012e37-b841-4296-a004-612e0a35be3c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:22.655456 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-87012e37-b841-4296-a004-612e0a35be3c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:22.660059 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-87012e37-b841-4296-a004-612e0a35be3c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:22.664833 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-87012e37-b841-4296-a004-612e0a35be3c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:22.664833 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-87012e37-b841-4296-a004-612e0a35be3c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:22.664833 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-87012e37-b841-4296-a004-612e0a35be3c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:22.686726 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-cd0492ca-1ef8-4b55-85e5-adf6e4e9e2dd tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:22.687969 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-cd0492ca-1ef8-4b55-85e5-adf6e4e9e2dd tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:22.702013 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cd0492ca-1ef8-4b55-85e5-adf6e4e9e2dd tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:22.702939 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cd0492ca-1ef8-4b55-85e5-adf6e4e9e2dd tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:22.703388 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cd0492ca-1ef8-4b55-85e5-adf6e4e9e2dd tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:22.704394 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cd0492ca-1ef8-4b55-85e5-adf6e4e9e2dd tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:22.705170 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cd0492ca-1ef8-4b55-85e5-adf6e4e9e2dd tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:22.706709 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cd0492ca-1ef8-4b55-85e5-adf6e4e9e2dd tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:22.777643 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-87012e37-b841-4296-a004-612e0a35be3c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:22.799935 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-87012e37-b841-4296-a004-612e0a35be3c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1210 microversion: 2.1 time: 0.178653 Sep 09 12:59:22.801717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 148/290] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:22 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1210 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:22.963103 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-cd0492ca-1ef8-4b55-85e5-adf6e4e9e2dd tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:22.967677 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:22.976133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-cd0492ca-1ef8-4b55-85e5-adf6e4e9e2dd tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.292210 Sep 09 12:59:22.976133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 143/291] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:22 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:23.177694 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-75ae6954-2ae0-49f7-bb1f-fa4da87e878d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:23.178523 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-75ae6954-2ae0-49f7-bb1f-fa4da87e878d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:23.194043 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-75ae6954-2ae0-49f7-bb1f-fa4da87e878d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:23.194043 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-75ae6954-2ae0-49f7-bb1f-fa4da87e878d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:23.194043 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-75ae6954-2ae0-49f7-bb1f-fa4da87e878d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:23.194043 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-75ae6954-2ae0-49f7-bb1f-fa4da87e878d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:23.194386 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-75ae6954-2ae0-49f7-bb1f-fa4da87e878d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:23.194386 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-75ae6954-2ae0-49f7-bb1f-fa4da87e878d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:23.690690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-75ae6954-2ae0-49f7-bb1f-fa4da87e878d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:23.705449 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-75ae6954-2ae0-49f7-bb1f-fa4da87e878d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:23.708872 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-75ae6954-2ae0-49f7-bb1f-fa4da87e878d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:23.711109 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-75ae6954-2ae0-49f7-bb1f-fa4da87e878d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.546339 Sep 09 12:59:23.713517 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 149/292] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:23 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:23.825231 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-395566c6-f60c-4a29-921e-367c2a20f6bb tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:23.825843 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-395566c6-f60c-4a29-921e-367c2a20f6bb tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:23.839382 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-395566c6-f60c-4a29-921e-367c2a20f6bb tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:23.840317 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-395566c6-f60c-4a29-921e-367c2a20f6bb tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:23.841060 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-395566c6-f60c-4a29-921e-367c2a20f6bb tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:23.841869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-395566c6-f60c-4a29-921e-367c2a20f6bb tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:23.842663 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-395566c6-f60c-4a29-921e-367c2a20f6bb tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:23.843301 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-395566c6-f60c-4a29-921e-367c2a20f6bb tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:24.006170 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-dc49194f-320c-4e0a-904e-592f49e98bc7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:24.008675 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-dc49194f-320c-4e0a-904e-592f49e98bc7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:24.016979 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=60 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:24.030437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-395566c6-f60c-4a29-921e-367c2a20f6bb tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:24.033003 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dc49194f-320c-4e0a-904e-592f49e98bc7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:24.033502 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dc49194f-320c-4e0a-904e-592f49e98bc7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:24.033984 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dc49194f-320c-4e0a-904e-592f49e98bc7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:24.034749 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dc49194f-320c-4e0a-904e-592f49e98bc7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:24.040675 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-395566c6-f60c-4a29-921e-367c2a20f6bb tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1278 microversion: 2.1 time: 0.220695 Sep 09 12:59:24.040880 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dc49194f-320c-4e0a-904e-592f49e98bc7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:24.042796 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dc49194f-320c-4e0a-904e-592f49e98bc7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:24.061089 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 144/293] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:23 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1278 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:24.338938 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-dc49194f-320c-4e0a-904e-592f49e98bc7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:24.349818 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-dc49194f-320c-4e0a-904e-592f49e98bc7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.352102 Sep 09 12:59:24.365469 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 150/294] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:23 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:24.737671 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-1c3f3b6f-c6a1-476d-9108-2c3a1f894ded req-d7b0d1d1-3808-44e7-b99b-f75ef7461d23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87", "tag": "cded5ff7-f97f-40e2-a004-1b7adc01e3da"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:59:24.741860 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-05ddcf53-83fe-4bf3-a91e-f604f052abcc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:24.742509 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-05ddcf53-83fe-4bf3-a91e-f604f052abcc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:24.757707 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-05ddcf53-83fe-4bf3-a91e-f604f052abcc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:24.759454 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-05ddcf53-83fe-4bf3-a91e-f604f052abcc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:24.763312 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-05ddcf53-83fe-4bf3-a91e-f604f052abcc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:24.763312 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-05ddcf53-83fe-4bf3-a91e-f604f052abcc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:24.763312 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-05ddcf53-83fe-4bf3-a91e-f604f052abcc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:24.763312 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-05ddcf53-83fe-4bf3-a91e-f604f052abcc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:24.769825 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-1c3f3b6f-c6a1-476d-9108-2c3a1f894ded req-d7b0d1d1-3808-44e7-b99b-f75ef7461d23 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:24.773314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-1c3f3b6f-c6a1-476d-9108-2c3a1f894ded req-d7b0d1d1-3808-44e7-b99b-f75ef7461d23 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:24.777647 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-1c3f3b6f-c6a1-476d-9108-2c3a1f894ded req-d7b0d1d1-3808-44e7-b99b-f75ef7461d23 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:24.845293 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-1c3f3b6f-c6a1-476d-9108-2c3a1f894ded req-d7b0d1d1-3808-44e7-b99b-f75ef7461d23 service nova] Creating event network-changed:cded5ff7-f97f-40e2-a004-1b7adc01e3da for instance c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 on hv-cinder-81322 Sep 09 12:59:24.855424 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-1c3f3b6f-c6a1-476d-9108-2c3a1f894ded req-d7b0d1d1-3808-44e7-b99b-f75ef7461d23 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124465 Sep 09 12:59:24.856027 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 145/295] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:59:25.072644 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-021a822a-8172-4ba1-99de-d17108e58fd5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:25.073555 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-021a822a-8172-4ba1-99de-d17108e58fd5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:25.080985 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-021a822a-8172-4ba1-99de-d17108e58fd5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:25.081928 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-021a822a-8172-4ba1-99de-d17108e58fd5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:25.082494 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-021a822a-8172-4ba1-99de-d17108e58fd5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:25.083349 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-021a822a-8172-4ba1-99de-d17108e58fd5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:25.083916 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-021a822a-8172-4ba1-99de-d17108e58fd5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:25.084460 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-021a822a-8172-4ba1-99de-d17108e58fd5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:25.142025 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-05ddcf53-83fe-4bf3-a91e-f604f052abcc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:25.142025 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-05ddcf53-83fe-4bf3-a91e-f604f052abcc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:25.142338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-05ddcf53-83fe-4bf3-a91e-f604f052abcc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:25.142338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-05ddcf53-83fe-4bf3-a91e-f604f052abcc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.385662 Sep 09 12:59:25.142338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 151/296] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:24 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:25.296522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-021a822a-8172-4ba1-99de-d17108e58fd5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:25.304896 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-021a822a-8172-4ba1-99de-d17108e58fd5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1266 microversion: 2.1 time: 0.238070 Sep 09 12:59:25.305555 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 146/297] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:25 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:25.378370 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-995b3471-c9bc-4c76-8de2-fd5192cb7c68 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:25.379051 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-995b3471-c9bc-4c76-8de2-fd5192cb7c68 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:25.386422 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-995b3471-c9bc-4c76-8de2-fd5192cb7c68 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:25.386971 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-995b3471-c9bc-4c76-8de2-fd5192cb7c68 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:25.393345 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-995b3471-c9bc-4c76-8de2-fd5192cb7c68 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:25.393345 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-995b3471-c9bc-4c76-8de2-fd5192cb7c68 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:25.393345 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-995b3471-c9bc-4c76-8de2-fd5192cb7c68 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:25.393345 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-995b3471-c9bc-4c76-8de2-fd5192cb7c68 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:25.394294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=100 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:25.542051 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-995b3471-c9bc-4c76-8de2-fd5192cb7c68 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:25.550142 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-995b3471-c9bc-4c76-8de2-fd5192cb7c68 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.176116 Sep 09 12:59:25.550747 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 152/298] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:25 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:26.152554 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-f2adf787-d3a3-4b60-9b7d-a63770697894 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:26.153999 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-f2adf787-d3a3-4b60-9b7d-a63770697894 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:26.164750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=2 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:26.165153 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:26.167120 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f2adf787-d3a3-4b60-9b7d-a63770697894 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:26.167818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f2adf787-d3a3-4b60-9b7d-a63770697894 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:26.168437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f2adf787-d3a3-4b60-9b7d-a63770697894 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:26.169339 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f2adf787-d3a3-4b60-9b7d-a63770697894 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:26.170018 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f2adf787-d3a3-4b60-9b7d-a63770697894 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:26.170456 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f2adf787-d3a3-4b60-9b7d-a63770697894 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:26.331583 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-436c9ae8-a446-4507-88a6-d1a072b322f0 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:26.333658 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-436c9ae8-a446-4507-88a6-d1a072b322f0 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:26.353275 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-436c9ae8-a446-4507-88a6-d1a072b322f0 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:26.354873 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-436c9ae8-a446-4507-88a6-d1a072b322f0 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:26.355522 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-436c9ae8-a446-4507-88a6-d1a072b322f0 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:26.356435 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-436c9ae8-a446-4507-88a6-d1a072b322f0 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:26.357065 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-436c9ae8-a446-4507-88a6-d1a072b322f0 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:26.357664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-436c9ae8-a446-4507-88a6-d1a072b322f0 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:26.359804 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-f2adf787-d3a3-4b60-9b7d-a63770697894 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:26.369870 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-f2adf787-d3a3-4b60-9b7d-a63770697894 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:26.371676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-f2adf787-d3a3-4b60-9b7d-a63770697894 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:26.373078 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-f2adf787-d3a3-4b60-9b7d-a63770697894 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.225435 Sep 09 12:59:26.374131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 147/299] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:26 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:59:26.552210 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-436c9ae8-a446-4507-88a6-d1a072b322f0 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:26.562662 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-436c9ae8-a446-4507-88a6-d1a072b322f0 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1266 microversion: 2.1 time: 0.236923 Sep 09 12:59:26.575174 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 153/300] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:26 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:26.576847 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-c301bafd-8f01-4bb8-9dcd-fd318376620e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:26.577482 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-c301bafd-8f01-4bb8-9dcd-fd318376620e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:26.586881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c301bafd-8f01-4bb8-9dcd-fd318376620e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:26.589097 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c301bafd-8f01-4bb8-9dcd-fd318376620e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:26.589097 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c301bafd-8f01-4bb8-9dcd-fd318376620e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:26.589615 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c301bafd-8f01-4bb8-9dcd-fd318376620e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:26.590129 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c301bafd-8f01-4bb8-9dcd-fd318376620e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:26.590593 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c301bafd-8f01-4bb8-9dcd-fd318376620e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:26.772654 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-c301bafd-8f01-4bb8-9dcd-fd318376620e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:26.781509 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-c301bafd-8f01-4bb8-9dcd-fd318376620e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.208541 Sep 09 12:59:26.782085 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 148/301] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:26 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:27.403336 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-14d199a2-901c-4b63-8511-3ed9090e4f96 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:27.404528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-14d199a2-901c-4b63-8511-3ed9090e4f96 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:27.410724 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-14d199a2-901c-4b63-8511-3ed9090e4f96 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:27.411214 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-14d199a2-901c-4b63-8511-3ed9090e4f96 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:27.411645 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-14d199a2-901c-4b63-8511-3ed9090e4f96 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:27.412484 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-14d199a2-901c-4b63-8511-3ed9090e4f96 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:27.413099 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-14d199a2-901c-4b63-8511-3ed9090e4f96 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:27.413779 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-14d199a2-901c-4b63-8511-3ed9090e4f96 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:27.550663 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-14d199a2-901c-4b63-8511-3ed9090e4f96 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:27.561916 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-14d199a2-901c-4b63-8511-3ed9090e4f96 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:27.563487 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-14d199a2-901c-4b63-8511-3ed9090e4f96 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:27.564891 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-14d199a2-901c-4b63-8511-3ed9090e4f96 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.166313 Sep 09 12:59:27.585981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 154/302] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:27 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:27.591733 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-f3b1a047-cbbc-4a52-8e0c-dbfe003052c7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:27.592885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-f3b1a047-cbbc-4a52-8e0c-dbfe003052c7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:27.595037 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=8 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:27.602538 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f3b1a047-cbbc-4a52-8e0c-dbfe003052c7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:27.603033 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f3b1a047-cbbc-4a52-8e0c-dbfe003052c7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:27.603455 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f3b1a047-cbbc-4a52-8e0c-dbfe003052c7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:27.604161 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f3b1a047-cbbc-4a52-8e0c-dbfe003052c7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:27.604635 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f3b1a047-cbbc-4a52-8e0c-dbfe003052c7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:27.605060 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f3b1a047-cbbc-4a52-8e0c-dbfe003052c7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:27.757476 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-f3b1a047-cbbc-4a52-8e0c-dbfe003052c7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:27.765512 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-f3b1a047-cbbc-4a52-8e0c-dbfe003052c7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1266 microversion: 2.1 time: 0.182816 Sep 09 12:59:27.766404 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 149/303] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:27 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:27.818235 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-992fb0f3-54a2-4df7-a577-98416db9097b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:27.819241 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-992fb0f3-54a2-4df7-a577-98416db9097b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:27.825940 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-992fb0f3-54a2-4df7-a577-98416db9097b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:27.826609 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-992fb0f3-54a2-4df7-a577-98416db9097b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:27.829052 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-992fb0f3-54a2-4df7-a577-98416db9097b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:27.830123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-992fb0f3-54a2-4df7-a577-98416db9097b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:27.830820 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-992fb0f3-54a2-4df7-a577-98416db9097b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:27.831368 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-992fb0f3-54a2-4df7-a577-98416db9097b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:27.976360 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-992fb0f3-54a2-4df7-a577-98416db9097b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:27.986370 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-992fb0f3-54a2-4df7-a577-98416db9097b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.170387 Sep 09 12:59:27.986370 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 155/304] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:27 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:28.600831 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-439748b0-5abd-449d-86b3-b6d0cbc64195 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:28.601375 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-439748b0-5abd-449d-86b3-b6d0cbc64195 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:28.608229 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-439748b0-5abd-449d-86b3-b6d0cbc64195 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:28.608721 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-439748b0-5abd-449d-86b3-b6d0cbc64195 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:28.609164 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-439748b0-5abd-449d-86b3-b6d0cbc64195 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:28.609867 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-439748b0-5abd-449d-86b3-b6d0cbc64195 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:28.610320 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-439748b0-5abd-449d-86b3-b6d0cbc64195 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:28.610775 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-439748b0-5abd-449d-86b3-b6d0cbc64195 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:28.751147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-439748b0-5abd-449d-86b3-b6d0cbc64195 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:28.759855 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-439748b0-5abd-449d-86b3-b6d0cbc64195 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:28.761285 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-439748b0-5abd-449d-86b3-b6d0cbc64195 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:28.762434 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-439748b0-5abd-449d-86b3-b6d0cbc64195 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.165646 Sep 09 12:59:28.763012 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 150/305] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:28 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:28.790065 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-17e03637-88bc-4427-a9a6-bafaee496296 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:28.790836 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-17e03637-88bc-4427-a9a6-bafaee496296 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:28.793512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=2 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:28.800763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-17e03637-88bc-4427-a9a6-bafaee496296 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:28.801462 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-17e03637-88bc-4427-a9a6-bafaee496296 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:28.802109 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-17e03637-88bc-4427-a9a6-bafaee496296 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:28.803004 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-17e03637-88bc-4427-a9a6-bafaee496296 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:28.803589 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-17e03637-88bc-4427-a9a6-bafaee496296 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:28.804113 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-17e03637-88bc-4427-a9a6-bafaee496296 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:28.940235 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-17e03637-88bc-4427-a9a6-bafaee496296 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:28.948469 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-17e03637-88bc-4427-a9a6-bafaee496296 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1266 microversion: 2.1 time: 0.163102 Sep 09 12:59:28.949016 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 156/306] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:28 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:29.007272 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-743401f4-570d-4e73-9ea6-9062126ca798 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:29.008777 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-743401f4-570d-4e73-9ea6-9062126ca798 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:29.014435 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-743401f4-570d-4e73-9ea6-9062126ca798 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:29.014949 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-743401f4-570d-4e73-9ea6-9062126ca798 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:29.015380 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-743401f4-570d-4e73-9ea6-9062126ca798 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:29.016170 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-743401f4-570d-4e73-9ea6-9062126ca798 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:29.016620 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-743401f4-570d-4e73-9ea6-9062126ca798 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:29.017042 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-743401f4-570d-4e73-9ea6-9062126ca798 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:29.161001 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-743401f4-570d-4e73-9ea6-9062126ca798 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:29.169323 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-743401f4-570d-4e73-9ea6-9062126ca798 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.165933 Sep 09 12:59:29.169944 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 151/307] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:29 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:29.797068 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-0bc882a9-1c08-4872-9f29-3ba70f5dc604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:29.797707 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-0bc882a9-1c08-4872-9f29-3ba70f5dc604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:29.804209 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0bc882a9-1c08-4872-9f29-3ba70f5dc604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:29.804691 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0bc882a9-1c08-4872-9f29-3ba70f5dc604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:29.807897 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0bc882a9-1c08-4872-9f29-3ba70f5dc604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:29.808764 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0bc882a9-1c08-4872-9f29-3ba70f5dc604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:29.809250 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0bc882a9-1c08-4872-9f29-3ba70f5dc604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:29.809684 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0bc882a9-1c08-4872-9f29-3ba70f5dc604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:29.971408 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-c6daaded-2fdf-4a99-aac3-f3d839b5b357 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:29.972026 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-c6daaded-2fdf-4a99-aac3-f3d839b5b357 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:29.979608 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c6daaded-2fdf-4a99-aac3-f3d839b5b357 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:29.980478 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c6daaded-2fdf-4a99-aac3-f3d839b5b357 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:29.981001 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c6daaded-2fdf-4a99-aac3-f3d839b5b357 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:29.981799 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c6daaded-2fdf-4a99-aac3-f3d839b5b357 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:29.982322 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c6daaded-2fdf-4a99-aac3-f3d839b5b357 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:29.983022 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c6daaded-2fdf-4a99-aac3-f3d839b5b357 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:29.988588 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-0bc882a9-1c08-4872-9f29-3ba70f5dc604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:30.000017 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-0bc882a9-1c08-4872-9f29-3ba70f5dc604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:30.001480 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-0bc882a9-1c08-4872-9f29-3ba70f5dc604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:30.003465 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-0bc882a9-1c08-4872-9f29-3ba70f5dc604 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.209760 Sep 09 12:59:30.004278 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 157/308] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:29 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:30.139816 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-c6daaded-2fdf-4a99-aac3-f3d839b5b357 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:30.149616 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-c6daaded-2fdf-4a99-aac3-f3d839b5b357 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1266 microversion: 2.1 time: 0.181455 Sep 09 12:59:30.164706 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 152/309] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:29 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:30.173834 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-fc4fd812-5216-4553-9f4f-6a790ae1cdbf tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:30.174476 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-fc4fd812-5216-4553-9f4f-6a790ae1cdbf tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:30.181691 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fc4fd812-5216-4553-9f4f-6a790ae1cdbf tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:30.182264 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fc4fd812-5216-4553-9f4f-6a790ae1cdbf tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:30.182945 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fc4fd812-5216-4553-9f4f-6a790ae1cdbf tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:30.183717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fc4fd812-5216-4553-9f4f-6a790ae1cdbf tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:30.184183 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fc4fd812-5216-4553-9f4f-6a790ae1cdbf tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:30.184612 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fc4fd812-5216-4553-9f4f-6a790ae1cdbf tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:30.195537 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2ca749c4-2526-498a-b8bd-97ab6fab59cf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:30.196651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2ca749c4-2526-498a-b8bd-97ab6fab59cf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:30.204125 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ca749c4-2526-498a-b8bd-97ab6fab59cf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:30.204861 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ca749c4-2526-498a-b8bd-97ab6fab59cf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:30.206212 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ca749c4-2526-498a-b8bd-97ab6fab59cf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:30.207042 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ca749c4-2526-498a-b8bd-97ab6fab59cf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:30.207601 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ca749c4-2526-498a-b8bd-97ab6fab59cf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:30.208227 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ca749c4-2526-498a-b8bd-97ab6fab59cf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:30.217083 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-fc4fd812-5216-4553-9f4f-6a790ae1cdbf tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb/ips" status: 200 len: 150 microversion: 2.1 time: 0.045624 Sep 09 12:59:30.224359 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 158/310] 10.222.0.46 () {58 vars in 1248 bytes} [Fri Sep 9 12:59:30 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb/ips => generated 150 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:59:30.229705 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-71bb167a-6820-4a80-9adc-4eabd09c442e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab711164-1a6a-4f8f-b353-5b028bbcb8da"}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:59:30.232669 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-71bb167a-6820-4a80-9adc-4eabd09c442e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:30.240772 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-71bb167a-6820-4a80-9adc-4eabd09c442e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:30.241269 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-71bb167a-6820-4a80-9adc-4eabd09c442e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:30.241694 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-71bb167a-6820-4a80-9adc-4eabd09c442e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:30.242393 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-71bb167a-6820-4a80-9adc-4eabd09c442e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:30.243484 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-71bb167a-6820-4a80-9adc-4eabd09c442e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:30.244220 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-71bb167a-6820-4a80-9adc-4eabd09c442e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:30.369587 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-71bb167a-6820-4a80-9adc-4eabd09c442e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] HTTP exception thrown: Invalid volume: volume ab711164-1a6a-4f8f-b353-5b028bbcb8da is already attached to instances: 7f59545d-0b40-4f82-94e2-789c728a6bed Sep 09 12:59:30.370629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2ca749c4-2526-498a-b8bd-97ab6fab59cf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:30.371599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-71bb167a-6820-4a80-9adc-4eabd09c442e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Request method failure captured: Sep 09 12:59:30.371599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: POST /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb/os-volume_attachments HTTP/1.1 Sep 09 12:59:30.371599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 12:59:30.371599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 12:59:30.371599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 12:59:30.371599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 74 Sep 09 12:59:30.371599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 12:59:30.371599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 12:59:30.371599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 12:59:30.371599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 12:59:30.371599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGzgEaKb6PZCqo9yxUSEJiFD1xb1LGODlWVgID9cA22eqBLNomTmu2q0yMgjccpW69nnUAUWKXMpFaG8X-sF87AhuIdLNOF9PvF4tjoZWf7SNwd1H5TWSvp_IUIt9lOp_NKX-JRPFLgnDrNAvr9jG5GRaXTb0sVN8rNo6hRRXay_HW10 Sep 09 12:59:30.371599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 12:59:30.371599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 12:59:30.371599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 12:59:30.371599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 12:59:30.371599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 12:59:30.371599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 12:59:30.371599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 12:59:30.371599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 12:59:30.371599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 12:59:30.371599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 12:59:30.372982 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ceed6a1f0f4542cbafa4b2a46b16d5fb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}] Sep 09 12:59:30.372982 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 12:59:30.372982 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 12:59:30.372982 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 12:59:30.372982 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 12:59:30.372982 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 12:59:30.372982 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 12:59:30.372982 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: 63a2902f465f4fd1aed80060c2669259 Sep 09 12:59:30.372982 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 12:59:30.372982 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Sep 09 12:59:30.372982 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {"volumeAttachment": {"volumeId": "ab711164-1a6a-4f8f-b353-5b028bbcb8da"}} Sep 09 12:59:30.372982 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: > Sep 09 12:59:30.373738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Invalid volume: volume ab711164-1a6a-4f8f-b353-5b028bbcb8da is already attached to instances: 7f59545d-0b40-4f82-94e2-789c728a6bed Sep 09 12:59:30.373738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'server_id': '1da39a54-b8f3-49a7-9447-497fadd2cefb', 'body': {'volumeAttachment': {'volumeId': 'ab711164-1a6a-4f8f-b353-5b028bbcb8da'}}} Sep 09 12:59:30.373738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:59:30.373738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:59:30.373738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 12:59:30.373738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 12:59:30.373738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 12:59:30.373738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 12:59:30.373738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 12:59:30.373738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 12:59:30.373738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 12:59:30.373738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 12:59:30.373738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 12:59:30.373738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 12:59:30.373738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ab711164-1a6a-4f8f-b353-5b028bbcb8da is already attached to instances: 7f59545d-0b40-4f82-94e2-789c728a6bed Sep 09 12:59:30.373738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:59:30.373738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:59:30.373738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:59:30.373738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:59:30.375215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:59:30.375215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:59:30.375215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:59:30.375215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:59:30.375215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:59:30.375215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:59:30.375215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:59:30.375215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:59:30.375215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:59:30.375215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:59:30.375215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:59:30.375215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:59:30.375215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 12:59:30.375215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 12:59:30.375215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ab711164-1a6a-4f8f-b353-5b028bbcb8da is already attached to instances: 7f59545d-0b40-4f82-94e2-789c728a6bed Sep 09 12:59:30.375215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:59:30.375215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:59:30.375215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:59:30.375215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:59:30.375215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:59:30.376636 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:59:30.376636 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:59:30.376636 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:59:30.376636 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ab711164-1a6a-4f8f-b353-5b028bbcb8da is already attached to instances: 7f59545d-0b40-4f82-94e2-789c728a6bed Sep 09 12:59:30.376636 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:59:30.378066 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-71bb167a-6820-4a80-9adc-4eabd09c442e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Returning 400 to user: Invalid volume: volume ab711164-1a6a-4f8f-b353-5b028bbcb8da is already attached to instances: 7f59545d-0b40-4f82-94e2-789c728a6bed {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:59:30.379088 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-71bb167a-6820-4a80-9adc-4eabd09c442e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "POST /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.153811 Sep 09 12:59:30.379788 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 159/311] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 12:59:30 2022] POST /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb/os-volume_attachments => generated 174 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 12:59:30.385499 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2ca749c4-2526-498a-b8bd-97ab6fab59cf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.196232 Sep 09 12:59:30.386613 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 153/312] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:30 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:30.392939 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-63af068a-4c11-4903-97a4-721f7ca92700 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:30.393496 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-63af068a-4c11-4903-97a4-721f7ca92700 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:30.401728 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-63af068a-4c11-4903-97a4-721f7ca92700 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:30.402304 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-63af068a-4c11-4903-97a4-721f7ca92700 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:30.402859 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-63af068a-4c11-4903-97a4-721f7ca92700 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:30.403633 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-63af068a-4c11-4903-97a4-721f7ca92700 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:30.404156 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-63af068a-4c11-4903-97a4-721f7ca92700 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:30.404652 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-63af068a-4c11-4903-97a4-721f7ca92700 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:30.432364 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-63af068a-4c11-4903-97a4-721f7ca92700 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Going to try to terminate instance {{(pid=127772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:59:30.752772 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-63af068a-4c11-4903-97a4-721f7ca92700 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 204 len: 0 microversion: 2.1 time: 0.368065 Sep 09 12:59:30.753490 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 160/313] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 12:59:30 2022] DELETE /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:59:30.761820 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-39f96e6d-e48a-4ba9-b3f7-14559d46aaef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:30.762575 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-39f96e6d-e48a-4ba9-b3f7-14559d46aaef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:30.768843 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-39f96e6d-e48a-4ba9-b3f7-14559d46aaef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:30.769343 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-39f96e6d-e48a-4ba9-b3f7-14559d46aaef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:30.772932 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-39f96e6d-e48a-4ba9-b3f7-14559d46aaef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:30.772932 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-39f96e6d-e48a-4ba9-b3f7-14559d46aaef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:30.772932 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-39f96e6d-e48a-4ba9-b3f7-14559d46aaef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:30.772932 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-39f96e6d-e48a-4ba9-b3f7-14559d46aaef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:30.916267 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-39f96e6d-e48a-4ba9-b3f7-14559d46aaef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:30.924986 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-39f96e6d-e48a-4ba9-b3f7-14559d46aaef tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1683 microversion: 2.1 time: 0.167138 Sep 09 12:59:30.926178 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 154/314] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:30 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:31.031319 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-41017fd7-cd08-4a97-9149-b419fe351a21 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:31.032011 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-41017fd7-cd08-4a97-9149-b419fe351a21 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:31.040194 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-41017fd7-cd08-4a97-9149-b419fe351a21 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:31.040687 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-41017fd7-cd08-4a97-9149-b419fe351a21 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:31.041133 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-41017fd7-cd08-4a97-9149-b419fe351a21 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:31.041841 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-41017fd7-cd08-4a97-9149-b419fe351a21 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:31.042301 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-41017fd7-cd08-4a97-9149-b419fe351a21 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:31.042766 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-41017fd7-cd08-4a97-9149-b419fe351a21 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:31.172003 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-45f44f89-1969-4b19-b904-f546d057728e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:31.172721 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-45f44f89-1969-4b19-b904-f546d057728e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:31.179462 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-45f44f89-1969-4b19-b904-f546d057728e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:31.180541 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-45f44f89-1969-4b19-b904-f546d057728e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:31.180975 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-45f44f89-1969-4b19-b904-f546d057728e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:31.184488 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-45f44f89-1969-4b19-b904-f546d057728e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:31.184488 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-45f44f89-1969-4b19-b904-f546d057728e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:31.184488 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-45f44f89-1969-4b19-b904-f546d057728e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:31.295926 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-41017fd7-cd08-4a97-9149-b419fe351a21 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:31.305458 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-41017fd7-cd08-4a97-9149-b419fe351a21 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:31.307255 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-41017fd7-cd08-4a97-9149-b419fe351a21 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:31.308447 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-41017fd7-cd08-4a97-9149-b419fe351a21 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.281889 Sep 09 12:59:31.316293 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 161/315] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:31 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:31.342348 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-45f44f89-1969-4b19-b904-f546d057728e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:31.352471 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-45f44f89-1969-4b19-b904-f546d057728e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1266 microversion: 2.1 time: 0.183768 Sep 09 12:59:31.359408 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 155/316] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:31 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:31.412306 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e7a6eb49-6a52-401a-9aed-001f074d7a1d tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:31.413064 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e7a6eb49-6a52-401a-9aed-001f074d7a1d tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:31.420042 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e7a6eb49-6a52-401a-9aed-001f074d7a1d tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:31.420615 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e7a6eb49-6a52-401a-9aed-001f074d7a1d tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:31.421129 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e7a6eb49-6a52-401a-9aed-001f074d7a1d tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:31.421902 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e7a6eb49-6a52-401a-9aed-001f074d7a1d tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:31.422450 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e7a6eb49-6a52-401a-9aed-001f074d7a1d tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:31.422964 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e7a6eb49-6a52-401a-9aed-001f074d7a1d tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:31.566104 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e7a6eb49-6a52-401a-9aed-001f074d7a1d tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:31.575070 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e7a6eb49-6a52-401a-9aed-001f074d7a1d tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.169044 Sep 09 12:59:31.575634 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 162/317] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:31 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:31.950265 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-87586486-d63f-417c-8d53-b4661be7c5ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:31.952349 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-87586486-d63f-417c-8d53-b4661be7c5ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:31.957631 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-87586486-d63f-417c-8d53-b4661be7c5ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:31.958129 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-87586486-d63f-417c-8d53-b4661be7c5ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:31.958614 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-87586486-d63f-417c-8d53-b4661be7c5ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:31.959332 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-87586486-d63f-417c-8d53-b4661be7c5ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:31.959786 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-87586486-d63f-417c-8d53-b4661be7c5ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:31.960217 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-87586486-d63f-417c-8d53-b4661be7c5ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:32.115248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-87586486-d63f-417c-8d53-b4661be7c5ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:32.125194 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-87586486-d63f-417c-8d53-b4661be7c5ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1683 microversion: 2.1 time: 0.179613 Sep 09 12:59:32.129534 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 156/318] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:31 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1683 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:32.335802 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-b09d2fbe-5086-4f11-9bb3-ea2d0de93303 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:32.337039 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-b09d2fbe-5086-4f11-9bb3-ea2d0de93303 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:32.345655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b09d2fbe-5086-4f11-9bb3-ea2d0de93303 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:32.346141 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b09d2fbe-5086-4f11-9bb3-ea2d0de93303 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:32.346604 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b09d2fbe-5086-4f11-9bb3-ea2d0de93303 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:32.347294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b09d2fbe-5086-4f11-9bb3-ea2d0de93303 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:32.347749 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b09d2fbe-5086-4f11-9bb3-ea2d0de93303 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:32.348174 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b09d2fbe-5086-4f11-9bb3-ea2d0de93303 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:32.381165 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-da242ff1-ae14-419d-bd2c-cc1099be8741 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:32.381760 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-da242ff1-ae14-419d-bd2c-cc1099be8741 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:32.389029 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-da242ff1-ae14-419d-bd2c-cc1099be8741 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:32.389526 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-da242ff1-ae14-419d-bd2c-cc1099be8741 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:32.389967 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-da242ff1-ae14-419d-bd2c-cc1099be8741 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:32.390698 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-da242ff1-ae14-419d-bd2c-cc1099be8741 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:32.391155 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-da242ff1-ae14-419d-bd2c-cc1099be8741 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:32.391652 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-da242ff1-ae14-419d-bd2c-cc1099be8741 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:32.479640 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-b09d2fbe-5086-4f11-9bb3-ea2d0de93303 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:32.488434 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-b09d2fbe-5086-4f11-9bb3-ea2d0de93303 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:32.489869 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-b09d2fbe-5086-4f11-9bb3-ea2d0de93303 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:32.491059 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-b09d2fbe-5086-4f11-9bb3-ea2d0de93303 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.159205 Sep 09 12:59:32.491610 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 163/319] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:32 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:32.536577 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-da242ff1-ae14-419d-bd2c-cc1099be8741 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:32.544853 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-da242ff1-ae14-419d-bd2c-cc1099be8741 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1266 microversion: 2.1 time: 0.167571 Sep 09 12:59:32.545418 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 157/320] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:32 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:32.599697 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-2cb0190a-848c-457c-a8ad-41ca9fd0ecaa tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:32.600345 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-2cb0190a-848c-457c-a8ad-41ca9fd0ecaa tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:32.606818 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2cb0190a-848c-457c-a8ad-41ca9fd0ecaa tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:32.607312 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2cb0190a-848c-457c-a8ad-41ca9fd0ecaa tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:32.607749 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2cb0190a-848c-457c-a8ad-41ca9fd0ecaa tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:32.608443 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2cb0190a-848c-457c-a8ad-41ca9fd0ecaa tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:32.608899 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2cb0190a-848c-457c-a8ad-41ca9fd0ecaa tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:32.609323 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2cb0190a-848c-457c-a8ad-41ca9fd0ecaa tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:32.746025 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-2cb0190a-848c-457c-a8ad-41ca9fd0ecaa tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:32.754027 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-2cb0190a-848c-457c-a8ad-41ca9fd0ecaa tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.159466 Sep 09 12:59:32.754832 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 164/321] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:32 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:33.148719 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0b56babb-24f4-4d1e-b935-216d10c7091a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:33.149336 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-0b56babb-24f4-4d1e-b935-216d10c7091a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:33.155997 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0b56babb-24f4-4d1e-b935-216d10c7091a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:33.156492 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0b56babb-24f4-4d1e-b935-216d10c7091a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:33.156936 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0b56babb-24f4-4d1e-b935-216d10c7091a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:33.157632 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0b56babb-24f4-4d1e-b935-216d10c7091a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:33.158091 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0b56babb-24f4-4d1e-b935-216d10c7091a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:33.158540 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0b56babb-24f4-4d1e-b935-216d10c7091a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:33.293356 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-0b56babb-24f4-4d1e-b935-216d10c7091a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:33.303900 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0b56babb-24f4-4d1e-b935-216d10c7091a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1683 microversion: 2.1 time: 0.158961 Sep 09 12:59:33.304470 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 158/322] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:33 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:33.516534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-6aa5b9e4-ebe8-4e84-9cc3-cf3303e57793 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:33.517152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-6aa5b9e4-ebe8-4e84-9cc3-cf3303e57793 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:33.523337 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6aa5b9e4-ebe8-4e84-9cc3-cf3303e57793 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:33.523826 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6aa5b9e4-ebe8-4e84-9cc3-cf3303e57793 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:33.524265 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6aa5b9e4-ebe8-4e84-9cc3-cf3303e57793 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:33.525611 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6aa5b9e4-ebe8-4e84-9cc3-cf3303e57793 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:33.526078 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6aa5b9e4-ebe8-4e84-9cc3-cf3303e57793 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:33.526523 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6aa5b9e4-ebe8-4e84-9cc3-cf3303e57793 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:33.567575 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d37e39dd-0e2d-4df4-a86e-7ec20f3168a8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:33.568191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-d37e39dd-0e2d-4df4-a86e-7ec20f3168a8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:33.575148 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d37e39dd-0e2d-4df4-a86e-7ec20f3168a8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:33.575640 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d37e39dd-0e2d-4df4-a86e-7ec20f3168a8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:33.576217 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d37e39dd-0e2d-4df4-a86e-7ec20f3168a8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:33.576920 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d37e39dd-0e2d-4df4-a86e-7ec20f3168a8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:33.577383 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d37e39dd-0e2d-4df4-a86e-7ec20f3168a8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:33.577811 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d37e39dd-0e2d-4df4-a86e-7ec20f3168a8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:33.669716 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-6aa5b9e4-ebe8-4e84-9cc3-cf3303e57793 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:33.678624 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-6aa5b9e4-ebe8-4e84-9cc3-cf3303e57793 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:33.680086 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-6aa5b9e4-ebe8-4e84-9cc3-cf3303e57793 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:33.681763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-6aa5b9e4-ebe8-4e84-9cc3-cf3303e57793 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.168777 Sep 09 12:59:33.683351 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 165/323] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:33 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:33.687137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a1df548a-1c54-4f65-91e1-f05a39c39f7f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Action: 'create', calling method: .version_select at 0x7f3183292670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-284832017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDc5Jtp45bGwETeNeFbGi5ZpJzK6QJS18TslrnuOTXsoB6T63NkfdFi53qqipMXBvwxy/0D0bdWBmCZ01JrfSz8wdGcAWtIafqezk+x4zD1Y3G0NzKgtUdC/DIMkafK5lQ=="}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:59:33.703700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-a1df548a-1c54-4f65-91e1-f05a39c39f7f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Getting quotas for project bfb3240493c84bda8102619400759342. Resources: {'key_pairs'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:59:33.707799 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-a1df548a-1c54-4f65-91e1-f05a39c39f7f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Getting quotas for user eb144bc11f4b4cd59e1f70ebd6b7207c and project bfb3240493c84bda8102619400759342. Resources: {'key_pairs'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:59:33.725112 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-d37e39dd-0e2d-4df4-a86e-7ec20f3168a8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:33.732975 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d37e39dd-0e2d-4df4-a86e-7ec20f3168a8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1266 microversion: 2.1 time: 0.169498 Sep 09 12:59:33.734800 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 159/324] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:33 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:33.779579 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-02449143-f176-4b06-9c95-adad9abcd503 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:33.780202 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-02449143-f176-4b06-9c95-adad9abcd503 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:33.786019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-02449143-f176-4b06-9c95-adad9abcd503 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:33.786526 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-02449143-f176-4b06-9c95-adad9abcd503 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:33.786996 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-02449143-f176-4b06-9c95-adad9abcd503 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:33.787644 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-02449143-f176-4b06-9c95-adad9abcd503 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:33.788095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-02449143-f176-4b06-9c95-adad9abcd503 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:33.788520 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-02449143-f176-4b06-9c95-adad9abcd503 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:33.791162 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a1df548a-1c54-4f65-91e1-f05a39c39f7f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.107279 Sep 09 12:59:33.792087 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 166/325] 10.222.0.46 () {60 vars in 1159 bytes} [Fri Sep 9 12:59:33 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:59:33.845081 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-865b9c74-2117-4ca6-a135-0b6e7c53c853 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1444132341", "imageRef": "5ad5aa48-c7e3-4a24-843c-8a54b6dff839", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-284832017", "networks": [{"uuid": "77276bd7-9a6e-49f9-9d00-b1ed63fd99c3"}]}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:59:33.911045 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.network.neutron [None req-865b9c74-2117-4ca6-a135-0b6e7c53c853 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] validate_networks() for [('77276bd7-9a6e-49f9-9d00-b1ed63fd99c3', None, None, None, None, None)] {{(pid=127772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:59:33.938196 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-02449143-f176-4b06-9c95-adad9abcd503 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:33.946723 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-02449143-f176-4b06-9c95-adad9abcd503 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.170998 Sep 09 12:59:33.947777 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 160/326] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:33 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:34.327304 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-3cbb8aa1-fa03-4aec-b0e2-5df89789836e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:34.329346 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-3cbb8aa1-fa03-4aec-b0e2-5df89789836e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:34.334557 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3cbb8aa1-fa03-4aec-b0e2-5df89789836e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:34.335008 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3cbb8aa1-fa03-4aec-b0e2-5df89789836e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:34.335448 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3cbb8aa1-fa03-4aec-b0e2-5df89789836e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:34.336134 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3cbb8aa1-fa03-4aec-b0e2-5df89789836e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:34.336588 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3cbb8aa1-fa03-4aec-b0e2-5df89789836e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:34.337009 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3cbb8aa1-fa03-4aec-b0e2-5df89789836e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:34.341428 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=100 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:34.475578 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-3cbb8aa1-fa03-4aec-b0e2-5df89789836e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:34.484485 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-3cbb8aa1-fa03-4aec-b0e2-5df89789836e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1683 microversion: 2.1 time: 0.161027 Sep 09 12:59:34.490429 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 161/327] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:34 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:34.709123 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0ee443f3-7672-4f02-a596-974930f08e36 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:34.709788 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-0ee443f3-7672-4f02-a596-974930f08e36 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:34.716467 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0ee443f3-7672-4f02-a596-974930f08e36 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:34.716949 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0ee443f3-7672-4f02-a596-974930f08e36 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:34.717383 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0ee443f3-7672-4f02-a596-974930f08e36 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:34.718072 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0ee443f3-7672-4f02-a596-974930f08e36 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:34.718540 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0ee443f3-7672-4f02-a596-974930f08e36 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:34.718966 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0ee443f3-7672-4f02-a596-974930f08e36 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:34.847454 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-0ee443f3-7672-4f02-a596-974930f08e36 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:34.857774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-0ee443f3-7672-4f02-a596-974930f08e36 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:34.859238 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-0ee443f3-7672-4f02-a596-974930f08e36 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:34.860412 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0ee443f3-7672-4f02-a596-974930f08e36 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.155619 Sep 09 12:59:34.860978 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 162/328] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:34 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:59:34.865786 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d256bb1d-0b2d-4550-895a-537b7282520c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:34.866418 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-d256bb1d-0b2d-4550-895a-537b7282520c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:34.873553 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d256bb1d-0b2d-4550-895a-537b7282520c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:34.874045 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d256bb1d-0b2d-4550-895a-537b7282520c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:34.874496 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d256bb1d-0b2d-4550-895a-537b7282520c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:34.875208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d256bb1d-0b2d-4550-895a-537b7282520c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:34.875688 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d256bb1d-0b2d-4550-895a-537b7282520c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:34.876114 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d256bb1d-0b2d-4550-895a-537b7282520c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:35.021129 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-d256bb1d-0b2d-4550-895a-537b7282520c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:35.028070 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d256bb1d-0b2d-4550-895a-537b7282520c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1266 microversion: 2.1 time: 0.165924 Sep 09 12:59:35.028672 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 163/329] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:34 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:35.033186 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-343eb270-0145-4476-be8a-5b35a79eda8c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:35.034016 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-343eb270-0145-4476-be8a-5b35a79eda8c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:35.041143 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-343eb270-0145-4476-be8a-5b35a79eda8c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:35.041634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-343eb270-0145-4476-be8a-5b35a79eda8c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:35.042129 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-343eb270-0145-4476-be8a-5b35a79eda8c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:35.042856 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-343eb270-0145-4476-be8a-5b35a79eda8c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:35.043312 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-343eb270-0145-4476-be8a-5b35a79eda8c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:35.044454 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-343eb270-0145-4476-be8a-5b35a79eda8c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:35.097772 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-865b9c74-2117-4ca6-a135-0b6e7c53c853 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Flavor limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:59:35.098250 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-865b9c74-2117-4ca6-a135-0b6e7c53c853 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Image limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:59:35.098680 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-865b9c74-2117-4ca6-a135-0b6e7c53c853 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Flavor pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:59:35.099094 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-865b9c74-2117-4ca6-a135-0b6e7c53c853 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Image pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:59:35.099503 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-865b9c74-2117-4ca6-a135-0b6e7c53c853 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:59:35.130144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-865b9c74-2117-4ca6-a135-0b6e7c53c853 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:35.130685 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-865b9c74-2117-4ca6-a135-0b6e7c53c853 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:35.131125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-865b9c74-2117-4ca6-a135-0b6e7c53c853 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:35.131846 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-865b9c74-2117-4ca6-a135-0b6e7c53c853 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:35.132296 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-865b9c74-2117-4ca6-a135-0b6e7c53c853 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:35.132715 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-865b9c74-2117-4ca6-a135-0b6e7c53c853 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:35.153680 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-865b9c74-2117-4ca6-a135-0b6e7c53c853 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Getting quotas for project bfb3240493c84bda8102619400759342. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:59:35.158223 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-865b9c74-2117-4ca6-a135-0b6e7c53c853 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Getting quotas for user eb144bc11f4b4cd59e1f70ebd6b7207c and project bfb3240493c84bda8102619400759342. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:59:35.170628 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-865b9c74-2117-4ca6-a135-0b6e7c53c853 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Going to run 1 instances... {{(pid=127772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:59:35.173066 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-865b9c74-2117-4ca6-a135-0b6e7c53c853 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5ad5aa48-c7e3-4a24-843c-8a54b6dff839',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:59:35.188484 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-343eb270-0145-4476-be8a-5b35a79eda8c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:35.196379 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-343eb270-0145-4476-be8a-5b35a79eda8c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.166766 Sep 09 12:59:35.197153 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 164/330] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:35 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:35.315109 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-865b9c74-2117-4ca6-a135-0b6e7c53c853 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.473996 Sep 09 12:59:35.315852 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 167/331] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 12:59:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 12:59:35.327948 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-cc324498-6275-4ef8-8582-298adc04d3ff tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:35.329906 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-cc324498-6275-4ef8-8582-298adc04d3ff tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:35.402744 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-cc324498-6275-4ef8-8582-298adc04d3ff tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:35.415317 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-cc324498-6275-4ef8-8582-298adc04d3ff tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1258 microversion: 2.1 time: 0.091696 Sep 09 12:59:35.426512 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 165/332] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:35 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1258 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:35.507629 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-95a3a4f9-be9a-4222-8507-fe5c906e72a6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:35.509848 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-95a3a4f9-be9a-4222-8507-fe5c906e72a6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:35.515042 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-95a3a4f9-be9a-4222-8507-fe5c906e72a6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:35.515520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-95a3a4f9-be9a-4222-8507-fe5c906e72a6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:35.515953 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-95a3a4f9-be9a-4222-8507-fe5c906e72a6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:35.516639 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-95a3a4f9-be9a-4222-8507-fe5c906e72a6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:35.517088 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-95a3a4f9-be9a-4222-8507-fe5c906e72a6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:35.517514 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-95a3a4f9-be9a-4222-8507-fe5c906e72a6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:35.805721 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-95a3a4f9-be9a-4222-8507-fe5c906e72a6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:35.811722 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-95a3a4f9-be9a-4222-8507-fe5c906e72a6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1683 microversion: 2.1 time: 0.308060 Sep 09 12:59:35.812921 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 168/333] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:35 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1683 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:35.889863 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-77b12fff-fa6a-4296-b39b-fd35f6e68c82 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:35.890665 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-77b12fff-fa6a-4296-b39b-fd35f6e68c82 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:35.906898 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-77b12fff-fa6a-4296-b39b-fd35f6e68c82 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:35.908661 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-77b12fff-fa6a-4296-b39b-fd35f6e68c82 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:35.909582 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-77b12fff-fa6a-4296-b39b-fd35f6e68c82 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:35.911211 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-77b12fff-fa6a-4296-b39b-fd35f6e68c82 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:35.913165 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-77b12fff-fa6a-4296-b39b-fd35f6e68c82 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:35.913674 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-77b12fff-fa6a-4296-b39b-fd35f6e68c82 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:35.982028 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-79bab736-b392-446d-85f8-eb18715ed2f0 req-f6bb465c-de29-40d4-9028-a24d25a632b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78dad9a3-ac85-4014-829c-986cca18c8b1", "name": "network-vif-plugged", "status": "completed", "tag": "244f1be5-c384-494f-b53f-53fb6f1b2689"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:59:36.000016 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-79bab736-b392-446d-85f8-eb18715ed2f0 req-f6bb465c-de29-40d4-9028-a24d25a632b3 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:36.001034 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-79bab736-b392-446d-85f8-eb18715ed2f0 req-f6bb465c-de29-40d4-9028-a24d25a632b3 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:36.001816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-79bab736-b392-446d-85f8-eb18715ed2f0 req-f6bb465c-de29-40d4-9028-a24d25a632b3 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:36.006138 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:36.022630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-79bab736-b392-446d-85f8-eb18715ed2f0 req-f6bb465c-de29-40d4-9028-a24d25a632b3 service nova] Creating event network-vif-plugged:244f1be5-c384-494f-b53f-53fb6f1b2689 for instance 78dad9a3-ac85-4014-829c-986cca18c8b1 on hv-cinder-81322 Sep 09 12:59:36.029235 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-79bab736-b392-446d-85f8-eb18715ed2f0 req-f6bb465c-de29-40d4-9028-a24d25a632b3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051476 Sep 09 12:59:36.030636 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 169/334] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:59:36.068834 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-77b12fff-fa6a-4296-b39b-fd35f6e68c82 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:36.079813 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-77b12fff-fa6a-4296-b39b-fd35f6e68c82 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:36.081583 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-77b12fff-fa6a-4296-b39b-fd35f6e68c82 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:36.082320 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-5e8a8e74-c32e-4a83-91d6-714a87610151 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:36.083217 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-5e8a8e74-c32e-4a83-91d6-714a87610151 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:36.083568 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-77b12fff-fa6a-4296-b39b-fd35f6e68c82 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.200130 Sep 09 12:59:36.084297 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 166/335] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:35 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:36.091484 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5e8a8e74-c32e-4a83-91d6-714a87610151 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:36.092095 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5e8a8e74-c32e-4a83-91d6-714a87610151 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:36.092629 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5e8a8e74-c32e-4a83-91d6-714a87610151 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:36.093430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5e8a8e74-c32e-4a83-91d6-714a87610151 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:36.094060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5e8a8e74-c32e-4a83-91d6-714a87610151 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:36.094520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5e8a8e74-c32e-4a83-91d6-714a87610151 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:36.220470 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-b5308198-eca5-4e17-a6e2-e53bbe7569eb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:36.221090 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-b5308198-eca5-4e17-a6e2-e53bbe7569eb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:36.227286 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b5308198-eca5-4e17-a6e2-e53bbe7569eb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:36.227809 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b5308198-eca5-4e17-a6e2-e53bbe7569eb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:36.228479 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b5308198-eca5-4e17-a6e2-e53bbe7569eb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:36.229390 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b5308198-eca5-4e17-a6e2-e53bbe7569eb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:36.230015 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b5308198-eca5-4e17-a6e2-e53bbe7569eb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:36.230500 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b5308198-eca5-4e17-a6e2-e53bbe7569eb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:36.324651 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-5e8a8e74-c32e-4a83-91d6-714a87610151 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:36.340325 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-5e8a8e74-c32e-4a83-91d6-714a87610151 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1266 microversion: 2.1 time: 0.271708 Sep 09 12:59:36.356177 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 170/336] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:36 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:36.356704 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-cbfdd5c0-fcf0-4798-8090-60a935c75e3f req-8d1eedaa-9797-4978-baad-3d3423bcbe5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da39a54-b8f3-49a7-9447-497fadd2cefb", "name": "network-vif-deleted", "tag": "e5f34505-ba7c-40ff-b43f-cf15fb7702b3"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:59:36.378990 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-b5308198-eca5-4e17-a6e2-e53bbe7569eb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:36.385964 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-cbfdd5c0-fcf0-4798-8090-60a935c75e3f req-8d1eedaa-9797-4978-baad-3d3423bcbe5e service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:36.387561 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-cbfdd5c0-fcf0-4798-8090-60a935c75e3f req-8d1eedaa-9797-4978-baad-3d3423bcbe5e service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:36.388320 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-cbfdd5c0-fcf0-4798-8090-60a935c75e3f req-8d1eedaa-9797-4978-baad-3d3423bcbe5e service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:36.403456 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-b5308198-eca5-4e17-a6e2-e53bbe7569eb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1500 microversion: 2.1 time: 0.186531 Sep 09 12:59:36.405832 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 167/337] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:36 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1500 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:36.423155 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-cbfdd5c0-fcf0-4798-8090-60a935c75e3f req-8d1eedaa-9797-4978-baad-3d3423bcbe5e service nova] Creating event network-vif-deleted:e5f34505-ba7c-40ff-b43f-cf15fb7702b3 for instance 1da39a54-b8f3-49a7-9447-497fadd2cefb on hv-cinder-81322 Sep 09 12:59:36.432755 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-93cec44a-f5e0-46e7-bdb2-a4d0b65ae245 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fea13160-867e-42c8-8335-1dd74fc9d8af"}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:59:36.435254 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-93cec44a-f5e0-46e7-bdb2-a4d0b65ae245 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:36.436023 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-cbfdd5c0-fcf0-4798-8090-60a935c75e3f req-8d1eedaa-9797-4978-baad-3d3423bcbe5e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091232 Sep 09 12:59:36.442711 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 171/338] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:59:36.448680 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-93cec44a-f5e0-46e7-bdb2-a4d0b65ae245 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:36.449428 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-93cec44a-f5e0-46e7-bdb2-a4d0b65ae245 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:36.450089 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-93cec44a-f5e0-46e7-bdb2-a4d0b65ae245 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:36.451794 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-b37fb302-98d3-4b8f-bb92-7f2d0a052698 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:36.453170 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-93cec44a-f5e0-46e7-bdb2-a4d0b65ae245 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:36.453817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-93cec44a-f5e0-46e7-bdb2-a4d0b65ae245 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:36.454897 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-93cec44a-f5e0-46e7-bdb2-a4d0b65ae245 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:36.455023 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-b37fb302-98d3-4b8f-bb92-7f2d0a052698 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:36.495788 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-93cec44a-f5e0-46e7-bdb2-a4d0b65ae245 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] HTTP exception thrown: Cannot 'attach_volume' instance 6d440fb7-9e24-433c-9cc5-282005be09bb while it is in vm_state rescued Sep 09 12:59:36.497841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-93cec44a-f5e0-46e7-bdb2-a4d0b65ae245 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Request method failure captured: Sep 09 12:59:36.497841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: POST /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb/os-volume_attachments HTTP/1.1 Sep 09 12:59:36.497841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 12:59:36.497841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 12:59:36.497841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 12:59:36.497841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 74 Sep 09 12:59:36.497841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 12:59:36.497841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 12:59:36.497841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 12:59:36.497841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 12:59:36.497841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzhNsxk3eImBO1lHZAvrWlWj7GQd9nwQo7dVWRc-D4q4nh-nTZUHAYAOoO00yWUPireTAtc9TmxercfFvEfPNb2QsAP1s4r0eJpff-pJCUKeW5tfgAvQ_8XMZSgUeBfCO_UYcV1LQt5l9z5gmZQwYMqHdUYhSL3od0VdvzDjeaTN7tA Sep 09 12:59:36.497841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 12:59:36.497841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 12:59:36.497841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 12:59:36.497841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 12:59:36.497841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 12:59:36.497841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 12:59:36.497841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: bf202f6eebd442e988e0f7307950a6c8 Sep 09 12:59:36.497841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-611080032 Sep 09 12:59:36.497841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 12:59:36.497841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 12:59:36.499561 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bf202f6eebd442e988e0f7307950a6c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bf202f6eebd442e988e0f7307950a6c8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bf202f6eebd442e988e0f7307950a6c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bf202f6eebd442e988e0f7307950a6c8"}]}] Sep 09 12:59:36.499561 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-ServerRescueNegativeTestJSON-611080032 Sep 09 12:59:36.499561 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: bf202f6eebd442e988e0f7307950a6c8 Sep 09 12:59:36.499561 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-611080032 Sep 09 12:59:36.499561 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-ServerRescueNegativeTestJSON-611080032-project Sep 09 12:59:36.499561 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 12:59:36.499561 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 12:59:36.499561 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 48f14caeb8f944c6aaf27913972869c7 Sep 09 12:59:36.499561 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-ServerRescueNegativeTestJSON-611080032-project Sep 09 12:59:36.499561 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Sep 09 12:59:36.499561 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {"volumeAttachment": {"volumeId": "fea13160-867e-42c8-8335-1dd74fc9d8af"}} Sep 09 12:59:36.499561 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 12:59:36.500522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Cannot 'attach_volume' instance 6d440fb7-9e24-433c-9cc5-282005be09bb while it is in vm_state rescued Sep 09 12:59:36.500522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'server_id': '6d440fb7-9e24-433c-9cc5-282005be09bb', 'body': {'volumeAttachment': {'volumeId': 'fea13160-867e-42c8-8335-1dd74fc9d8af'}}} Sep 09 12:59:36.500522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:59:36.500522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:59:36.500522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 12:59:36.500522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 12:59:36.500522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 12:59:36.500522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 12:59:36.500522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 12:59:36.500522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 12:59:36.500522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6d440fb7-9e24-433c-9cc5-282005be09bb in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 09 12:59:36.500522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:59:36.500522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:59:36.500522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:59:36.500522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:59:36.500522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:59:36.500522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:59:36.500522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:59:36.500522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:59:36.501937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:59:36.501937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:59:36.501937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:59:36.501937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:59:36.501937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:59:36.501937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:59:36.501937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:59:36.501937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:59:36.501937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 09 12:59:36.501937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 12:59:36.501937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 12:59:36.501937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 12:59:36.501937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6d440fb7-9e24-433c-9cc5-282005be09bb while it is in vm_state rescued Sep 09 12:59:36.501937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:59:36.501937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:59:36.501937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:59:36.501937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:59:36.501937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:59:36.501937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:59:36.503360 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:59:36.503360 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:59:36.503360 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6d440fb7-9e24-433c-9cc5-282005be09bb while it is in vm_state rescued Sep 09 12:59:36.503360 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 12:59:36.515567 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-93cec44a-f5e0-46e7-bdb2-a4d0b65ae245 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Returning 409 to user: Cannot 'attach_volume' instance 6d440fb7-9e24-433c-9cc5-282005be09bb while it is in vm_state rescued {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:59:36.520229 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-93cec44a-f5e0-46e7-bdb2-a4d0b65ae245 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "POST /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.091483 Sep 09 12:59:36.522557 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 168/339] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 12:59:36 2022] POST /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb/os-volume_attachments => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 09 12:59:36.532719 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-9548f744-969e-4750-b0e6-cd9501198389 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:59:36.533533 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-9548f744-969e-4750-b0e6-cd9501198389 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:36.539293 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-b37fb302-98d3-4b8f-bb92-7f2d0a052698 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:36.540596 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9548f744-969e-4750-b0e6-cd9501198389 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:36.541268 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9548f744-969e-4750-b0e6-cd9501198389 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:36.541889 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9548f744-969e-4750-b0e6-cd9501198389 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:36.542800 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9548f744-969e-4750-b0e6-cd9501198389 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:36.543406 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9548f744-969e-4750-b0e6-cd9501198389 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:36.544008 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9548f744-969e-4750-b0e6-cd9501198389 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:36.547604 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-b37fb302-98d3-4b8f-bb92-7f2d0a052698 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1258 microversion: 2.1 time: 0.102175 Sep 09 12:59:36.548182 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 172/340] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:36 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1258 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:36.788206 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-9548f744-969e-4750-b0e6-cd9501198389 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "POST /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb/action" status: 202 len: 0 microversion: 2.1 time: 0.260332 Sep 09 12:59:36.789271 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 169/341] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 12:59:36 2022] POST /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:59:36.797679 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-0486aa25-a6d2-4224-8f81-af732f14dbfe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:36.798585 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-0486aa25-a6d2-4224-8f81-af732f14dbfe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:36.805408 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0486aa25-a6d2-4224-8f81-af732f14dbfe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:36.805905 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0486aa25-a6d2-4224-8f81-af732f14dbfe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:36.806355 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0486aa25-a6d2-4224-8f81-af732f14dbfe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:36.807202 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0486aa25-a6d2-4224-8f81-af732f14dbfe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:36.807669 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0486aa25-a6d2-4224-8f81-af732f14dbfe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:36.808103 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0486aa25-a6d2-4224-8f81-af732f14dbfe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:36.835681 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-bca76355-cb62-4ad4-90af-5c101bf47d89 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:36.836639 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-bca76355-cb62-4ad4-90af-5c101bf47d89 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:36.847033 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bca76355-cb62-4ad4-90af-5c101bf47d89 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:36.849937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bca76355-cb62-4ad4-90af-5c101bf47d89 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:36.851222 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bca76355-cb62-4ad4-90af-5c101bf47d89 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:36.852173 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bca76355-cb62-4ad4-90af-5c101bf47d89 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:36.856086 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bca76355-cb62-4ad4-90af-5c101bf47d89 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:36.856733 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bca76355-cb62-4ad4-90af-5c101bf47d89 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:36.926434 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-bca76355-cb62-4ad4-90af-5c101bf47d89 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:36.936392 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-bca76355-cb62-4ad4-90af-5c101bf47d89 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1327 microversion: 2.1 time: 0.104942 Sep 09 12:59:36.937678 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 170/342] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:36 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:37.116674 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-036e5374-4b93-4e6a-a1ad-6c9ad75112c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:37.122865 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-036e5374-4b93-4e6a-a1ad-6c9ad75112c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:37.130524 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-036e5374-4b93-4e6a-a1ad-6c9ad75112c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:37.137123 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-036e5374-4b93-4e6a-a1ad-6c9ad75112c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:37.137583 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-036e5374-4b93-4e6a-a1ad-6c9ad75112c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:37.138335 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-036e5374-4b93-4e6a-a1ad-6c9ad75112c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:37.138830 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-036e5374-4b93-4e6a-a1ad-6c9ad75112c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:37.139507 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-036e5374-4b93-4e6a-a1ad-6c9ad75112c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:37.169496 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-0486aa25-a6d2-4224-8f81-af732f14dbfe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:37.182237 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-0486aa25-a6d2-4224-8f81-af732f14dbfe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1508 microversion: 2.1 time: 0.385087 Sep 09 12:59:37.185275 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 173/343] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:36 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1508 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:37.351923 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-036e5374-4b93-4e6a-a1ad-6c9ad75112c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:37.362989 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-036e5374-4b93-4e6a-a1ad-6c9ad75112c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:37.364578 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-036e5374-4b93-4e6a-a1ad-6c9ad75112c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:37.366003 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-036e5374-4b93-4e6a-a1ad-6c9ad75112c9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.258829 Sep 09 12:59:37.367256 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 171/344] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:37 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:37.368199 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-57ff86f7-c5ea-4d27-8dc0-a5888eff5061 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:37.372370 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-57ff86f7-c5ea-4d27-8dc0-a5888eff5061 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:37.383406 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-57ff86f7-c5ea-4d27-8dc0-a5888eff5061 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:37.383905 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-57ff86f7-c5ea-4d27-8dc0-a5888eff5061 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:37.384534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-57ff86f7-c5ea-4d27-8dc0-a5888eff5061 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:37.385605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-57ff86f7-c5ea-4d27-8dc0-a5888eff5061 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:37.386895 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-57ff86f7-c5ea-4d27-8dc0-a5888eff5061 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:37.387503 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-57ff86f7-c5ea-4d27-8dc0-a5888eff5061 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:37.534347 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-57ff86f7-c5ea-4d27-8dc0-a5888eff5061 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:37.542908 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-57ff86f7-c5ea-4d27-8dc0-a5888eff5061 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1266 microversion: 2.1 time: 0.182686 Sep 09 12:59:37.543485 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 174/345] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:37 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:37.572275 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-19076932-e6b8-4bd5-b807-cbdf3a297cf0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:37.573279 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-19076932-e6b8-4bd5-b807-cbdf3a297cf0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:37.587781 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-19076932-e6b8-4bd5-b807-cbdf3a297cf0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:37.588630 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-19076932-e6b8-4bd5-b807-cbdf3a297cf0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:37.589447 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-19076932-e6b8-4bd5-b807-cbdf3a297cf0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:37.590363 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-19076932-e6b8-4bd5-b807-cbdf3a297cf0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:37.591075 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-19076932-e6b8-4bd5-b807-cbdf3a297cf0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:37.591713 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-19076932-e6b8-4bd5-b807-cbdf3a297cf0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:37.694819 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-19076932-e6b8-4bd5-b807-cbdf3a297cf0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:37.707840 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-19076932-e6b8-4bd5-b807-cbdf3a297cf0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1254 microversion: 2.1 time: 0.139560 Sep 09 12:59:37.722533 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 172/346] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:37 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1254 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:37.959792 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-124f3ee0-b2bf-43d4-859c-80356fc5e43b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:37.960365 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-124f3ee0-b2bf-43d4-859c-80356fc5e43b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:37.967527 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-124f3ee0-b2bf-43d4-859c-80356fc5e43b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:37.968052 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-124f3ee0-b2bf-43d4-859c-80356fc5e43b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:37.968490 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-124f3ee0-b2bf-43d4-859c-80356fc5e43b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:37.969198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-124f3ee0-b2bf-43d4-859c-80356fc5e43b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:37.969653 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-124f3ee0-b2bf-43d4-859c-80356fc5e43b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:37.970081 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-124f3ee0-b2bf-43d4-859c-80356fc5e43b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:38.005815 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-124f3ee0-b2bf-43d4-859c-80356fc5e43b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:38.006316 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-124f3ee0-b2bf-43d4-859c-80356fc5e43b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:38.006781 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-124f3ee0-b2bf-43d4-859c-80356fc5e43b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:38.007245 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.objects.instance [None req-124f3ee0-b2bf-43d4-859c-80356fc5e43b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lazy-loading 'fault' on Instance uuid 1da39a54-b8f3-49a7-9447-497fadd2cefb {{(pid=127772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:59:38.049712 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-124f3ee0-b2bf-43d4-859c-80356fc5e43b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:38.058332 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-124f3ee0-b2bf-43d4-859c-80356fc5e43b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1332 microversion: 2.1 time: 0.102423 Sep 09 12:59:38.058949 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 175/347] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:37 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:38.213041 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-af46cb7e-5355-40cf-a0df-b1d8b8eb8772 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:38.213737 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-af46cb7e-5355-40cf-a0df-b1d8b8eb8772 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:38.220098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-af46cb7e-5355-40cf-a0df-b1d8b8eb8772 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:38.220583 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-af46cb7e-5355-40cf-a0df-b1d8b8eb8772 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:38.221019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-af46cb7e-5355-40cf-a0df-b1d8b8eb8772 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:38.221711 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-af46cb7e-5355-40cf-a0df-b1d8b8eb8772 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:38.222158 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-af46cb7e-5355-40cf-a0df-b1d8b8eb8772 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:38.222811 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-af46cb7e-5355-40cf-a0df-b1d8b8eb8772 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:38.373002 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-af46cb7e-5355-40cf-a0df-b1d8b8eb8772 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:38.383558 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-af46cb7e-5355-40cf-a0df-b1d8b8eb8772 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1508 microversion: 2.1 time: 0.174538 Sep 09 12:59:38.384898 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 173/348] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:38 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:38.401672 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-fee406e1-e9de-4469-b7d0-54e002feb241 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:38.402078 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-fee406e1-e9de-4469-b7d0-54e002feb241 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:38.408821 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fee406e1-e9de-4469-b7d0-54e002feb241 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:38.409306 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fee406e1-e9de-4469-b7d0-54e002feb241 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:38.409756 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fee406e1-e9de-4469-b7d0-54e002feb241 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:38.410446 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fee406e1-e9de-4469-b7d0-54e002feb241 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:38.410981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fee406e1-e9de-4469-b7d0-54e002feb241 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:38.411408 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fee406e1-e9de-4469-b7d0-54e002feb241 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:38.550367 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-fee406e1-e9de-4469-b7d0-54e002feb241 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:38.558897 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-fee406e1-e9de-4469-b7d0-54e002feb241 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:38.560323 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-fee406e1-e9de-4469-b7d0-54e002feb241 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:38.561469 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-fee406e1-e9de-4469-b7d0-54e002feb241 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.166219 Sep 09 12:59:38.562147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 176/349] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:38 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:38.565304 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-45e96ee1-a855-4b94-a8a2-8438c3b67b2a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:38.565950 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-45e96ee1-a855-4b94-a8a2-8438c3b67b2a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:38.572443 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-45e96ee1-a855-4b94-a8a2-8438c3b67b2a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:38.572918 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-45e96ee1-a855-4b94-a8a2-8438c3b67b2a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:38.573352 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-45e96ee1-a855-4b94-a8a2-8438c3b67b2a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:38.574034 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-45e96ee1-a855-4b94-a8a2-8438c3b67b2a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:38.574502 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-45e96ee1-a855-4b94-a8a2-8438c3b67b2a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:38.575034 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-45e96ee1-a855-4b94-a8a2-8438c3b67b2a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:38.702542 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-45e96ee1-a855-4b94-a8a2-8438c3b67b2a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:38.710421 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-45e96ee1-a855-4b94-a8a2-8438c3b67b2a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1266 microversion: 2.1 time: 0.149172 Sep 09 12:59:38.711020 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 174/350] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:38 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:38.732773 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-f81ff0d8-eb29-4a3c-a35b-f2e389aa34ad tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:38.733312 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-f81ff0d8-eb29-4a3c-a35b-f2e389aa34ad tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:38.739427 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f81ff0d8-eb29-4a3c-a35b-f2e389aa34ad tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:38.739915 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f81ff0d8-eb29-4a3c-a35b-f2e389aa34ad tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:38.740347 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f81ff0d8-eb29-4a3c-a35b-f2e389aa34ad tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:38.741072 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f81ff0d8-eb29-4a3c-a35b-f2e389aa34ad tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:38.741523 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f81ff0d8-eb29-4a3c-a35b-f2e389aa34ad tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:38.741950 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f81ff0d8-eb29-4a3c-a35b-f2e389aa34ad tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:38.807432 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-f81ff0d8-eb29-4a3c-a35b-f2e389aa34ad tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:38.815457 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-f81ff0d8-eb29-4a3c-a35b-f2e389aa34ad tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1254 microversion: 2.1 time: 0.086541 Sep 09 12:59:38.816027 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 177/351] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:38 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1254 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:39.082187 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ed106601-4f3e-4ba9-b3c9-053749233bf0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:39.082737 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ed106601-4f3e-4ba9-b3c9-053749233bf0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:39.089440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ed106601-4f3e-4ba9-b3c9-053749233bf0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:39.089923 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ed106601-4f3e-4ba9-b3c9-053749233bf0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:39.090360 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ed106601-4f3e-4ba9-b3c9-053749233bf0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:39.091069 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ed106601-4f3e-4ba9-b3c9-053749233bf0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:39.091526 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ed106601-4f3e-4ba9-b3c9-053749233bf0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:39.091950 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ed106601-4f3e-4ba9-b3c9-053749233bf0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:39.124210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ed106601-4f3e-4ba9-b3c9-053749233bf0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:39.124689 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ed106601-4f3e-4ba9-b3c9-053749233bf0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:39.125313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ed106601-4f3e-4ba9-b3c9-053749233bf0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:39.125552 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.objects.instance [None req-ed106601-4f3e-4ba9-b3c9-053749233bf0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lazy-loading 'fault' on Instance uuid 1da39a54-b8f3-49a7-9447-497fadd2cefb {{(pid=127771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:59:39.167382 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ed106601-4f3e-4ba9-b3c9-053749233bf0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:39.174859 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ed106601-4f3e-4ba9-b3c9-053749233bf0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1332 microversion: 2.1 time: 0.096834 Sep 09 12:59:39.175414 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 175/352] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:39 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:39.407788 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-d2cd6f48-155f-45f6-9620-b6e9f80bc2ec tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:39.408404 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-d2cd6f48-155f-45f6-9620-b6e9f80bc2ec tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:39.414624 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d2cd6f48-155f-45f6-9620-b6e9f80bc2ec tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:39.415111 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d2cd6f48-155f-45f6-9620-b6e9f80bc2ec tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:39.415653 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d2cd6f48-155f-45f6-9620-b6e9f80bc2ec tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:39.416354 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d2cd6f48-155f-45f6-9620-b6e9f80bc2ec tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:39.416802 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d2cd6f48-155f-45f6-9620-b6e9f80bc2ec tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:39.417221 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d2cd6f48-155f-45f6-9620-b6e9f80bc2ec tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:39.547752 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-d2cd6f48-155f-45f6-9620-b6e9f80bc2ec tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:39.555491 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-d2cd6f48-155f-45f6-9620-b6e9f80bc2ec tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1508 microversion: 2.1 time: 0.151735 Sep 09 12:59:39.556068 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 178/353] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:39 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:39.588445 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-589b3637-e2c3-4cec-9b1a-57cc8e3e0f05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:39.588974 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-589b3637-e2c3-4cec-9b1a-57cc8e3e0f05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:39.595303 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-589b3637-e2c3-4cec-9b1a-57cc8e3e0f05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:39.595777 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-589b3637-e2c3-4cec-9b1a-57cc8e3e0f05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:39.596209 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-589b3637-e2c3-4cec-9b1a-57cc8e3e0f05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:39.596885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-589b3637-e2c3-4cec-9b1a-57cc8e3e0f05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:39.597332 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-589b3637-e2c3-4cec-9b1a-57cc8e3e0f05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:39.597751 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-589b3637-e2c3-4cec-9b1a-57cc8e3e0f05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:39.733684 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-53feccc3-5a88-4f46-8140-f8872b708ece tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:39.734312 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-53feccc3-5a88-4f46-8140-f8872b708ece tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:39.738949 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-589b3637-e2c3-4cec-9b1a-57cc8e3e0f05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:39.740759 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-53feccc3-5a88-4f46-8140-f8872b708ece tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:39.741258 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-53feccc3-5a88-4f46-8140-f8872b708ece tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:39.741696 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-53feccc3-5a88-4f46-8140-f8872b708ece tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:39.742652 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-53feccc3-5a88-4f46-8140-f8872b708ece tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:39.744063 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-53feccc3-5a88-4f46-8140-f8872b708ece tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:39.744711 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-53feccc3-5a88-4f46-8140-f8872b708ece tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:39.748902 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-589b3637-e2c3-4cec-9b1a-57cc8e3e0f05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:39.750437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-589b3637-e2c3-4cec-9b1a-57cc8e3e0f05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:39.751921 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-589b3637-e2c3-4cec-9b1a-57cc8e3e0f05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.168130 Sep 09 12:59:39.752462 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 176/354] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:39 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:39.839439 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ad7bc481-b789-4652-b82c-2ea19c578722 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:39.839990 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ad7bc481-b789-4652-b82c-2ea19c578722 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:39.847287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ad7bc481-b789-4652-b82c-2ea19c578722 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:39.848291 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ad7bc481-b789-4652-b82c-2ea19c578722 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:39.849088 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ad7bc481-b789-4652-b82c-2ea19c578722 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:39.850284 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ad7bc481-b789-4652-b82c-2ea19c578722 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:39.851407 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ad7bc481-b789-4652-b82c-2ea19c578722 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:39.851854 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ad7bc481-b789-4652-b82c-2ea19c578722 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:39.887843 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-53feccc3-5a88-4f46-8140-f8872b708ece tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:39.898921 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-53feccc3-5a88-4f46-8140-f8872b708ece tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1266 microversion: 2.1 time: 0.169188 Sep 09 12:59:39.911296 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 179/355] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:39 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:39.921773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ad7bc481-b789-4652-b82c-2ea19c578722 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:39.925242 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:39.929850 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ad7bc481-b789-4652-b82c-2ea19c578722 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1254 microversion: 2.1 time: 0.095093 Sep 09 12:59:39.930405 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 177/356] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:39 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1254 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:40.199123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-32cfb77d-8a1c-46e1-bd3c-81de7945a945 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:40.199843 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-32cfb77d-8a1c-46e1-bd3c-81de7945a945 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:40.205922 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-32cfb77d-8a1c-46e1-bd3c-81de7945a945 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:40.209952 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-32cfb77d-8a1c-46e1-bd3c-81de7945a945 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:40.209952 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-32cfb77d-8a1c-46e1-bd3c-81de7945a945 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:40.209952 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-32cfb77d-8a1c-46e1-bd3c-81de7945a945 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:40.209952 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-32cfb77d-8a1c-46e1-bd3c-81de7945a945 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:40.210291 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-32cfb77d-8a1c-46e1-bd3c-81de7945a945 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:40.239587 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-32cfb77d-8a1c-46e1-bd3c-81de7945a945 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:40.240066 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-32cfb77d-8a1c-46e1-bd3c-81de7945a945 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:40.240495 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-32cfb77d-8a1c-46e1-bd3c-81de7945a945 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:40.240938 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.objects.instance [None req-32cfb77d-8a1c-46e1-bd3c-81de7945a945 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lazy-loading 'fault' on Instance uuid 1da39a54-b8f3-49a7-9447-497fadd2cefb {{(pid=127772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:59:40.285491 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-32cfb77d-8a1c-46e1-bd3c-81de7945a945 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:40.294536 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-32cfb77d-8a1c-46e1-bd3c-81de7945a945 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1332 microversion: 2.1 time: 0.099767 Sep 09 12:59:40.297154 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 180/357] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:40 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:40.578765 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-dcfe4350-6e2f-40d2-9a98-856a0925097c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:40.579648 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-dcfe4350-6e2f-40d2-9a98-856a0925097c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:40.586525 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dcfe4350-6e2f-40d2-9a98-856a0925097c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:40.587021 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dcfe4350-6e2f-40d2-9a98-856a0925097c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:40.588026 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dcfe4350-6e2f-40d2-9a98-856a0925097c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:40.588894 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dcfe4350-6e2f-40d2-9a98-856a0925097c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:40.589434 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dcfe4350-6e2f-40d2-9a98-856a0925097c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:40.589824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dcfe4350-6e2f-40d2-9a98-856a0925097c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:40.722523 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-dcfe4350-6e2f-40d2-9a98-856a0925097c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:40.731021 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-dcfe4350-6e2f-40d2-9a98-856a0925097c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1508 microversion: 2.1 time: 0.156425 Sep 09 12:59:40.731576 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 178/358] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:40 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:40.778978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-67e94e77-f62f-41c6-8981-aa01051704e0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:40.779594 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-67e94e77-f62f-41c6-8981-aa01051704e0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:40.781576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:40.786206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-67e94e77-f62f-41c6-8981-aa01051704e0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:40.786720 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-67e94e77-f62f-41c6-8981-aa01051704e0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:40.787156 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-67e94e77-f62f-41c6-8981-aa01051704e0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:40.787848 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-67e94e77-f62f-41c6-8981-aa01051704e0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:40.788304 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-67e94e77-f62f-41c6-8981-aa01051704e0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:40.789995 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-67e94e77-f62f-41c6-8981-aa01051704e0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:40.917194 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-67e94e77-f62f-41c6-8981-aa01051704e0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:40.922559 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-353f7f7f-a102-47bc-ba75-1458d5c558b9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:40.923250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-353f7f7f-a102-47bc-ba75-1458d5c558b9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:40.926276 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-67e94e77-f62f-41c6-8981-aa01051704e0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:40.927803 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-67e94e77-f62f-41c6-8981-aa01051704e0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:40.928974 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-67e94e77-f62f-41c6-8981-aa01051704e0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1808 microversion: 2.20 time: 0.154581 Sep 09 12:59:40.929399 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-353f7f7f-a102-47bc-ba75-1458d5c558b9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:40.929518 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 181/359] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:40 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:40.929877 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-353f7f7f-a102-47bc-ba75-1458d5c558b9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:40.930308 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-353f7f7f-a102-47bc-ba75-1458d5c558b9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:40.931214 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-353f7f7f-a102-47bc-ba75-1458d5c558b9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:40.931465 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-353f7f7f-a102-47bc-ba75-1458d5c558b9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:40.931886 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-353f7f7f-a102-47bc-ba75-1458d5c558b9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:40.953485 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-5259067b-e571-4b08-9dd6-85df232f330f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:40.954665 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-5259067b-e571-4b08-9dd6-85df232f330f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:40.961382 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5259067b-e571-4b08-9dd6-85df232f330f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:40.961873 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5259067b-e571-4b08-9dd6-85df232f330f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:40.963026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5259067b-e571-4b08-9dd6-85df232f330f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:40.963846 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5259067b-e571-4b08-9dd6-85df232f330f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:40.964336 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5259067b-e571-4b08-9dd6-85df232f330f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:40.965009 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5259067b-e571-4b08-9dd6-85df232f330f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:41.026516 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-5259067b-e571-4b08-9dd6-85df232f330f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:41.034696 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-5259067b-e571-4b08-9dd6-85df232f330f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1254 microversion: 2.1 time: 0.085007 Sep 09 12:59:41.036422 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 182/360] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:40 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1254 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:41.080442 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-353f7f7f-a102-47bc-ba75-1458d5c558b9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:41.088614 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-353f7f7f-a102-47bc-ba75-1458d5c558b9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1266 microversion: 2.1 time: 0.169866 Sep 09 12:59:41.089174 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 179/361] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:40 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:41.317394 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-03fb1e96-0aff-4273-a9b0-df1620358ca4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:41.317964 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-03fb1e96-0aff-4273-a9b0-df1620358ca4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:41.324037 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-03fb1e96-0aff-4273-a9b0-df1620358ca4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:41.324521 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-03fb1e96-0aff-4273-a9b0-df1620358ca4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:41.324958 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-03fb1e96-0aff-4273-a9b0-df1620358ca4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:41.325654 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-03fb1e96-0aff-4273-a9b0-df1620358ca4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:41.326108 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-03fb1e96-0aff-4273-a9b0-df1620358ca4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:41.326555 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-03fb1e96-0aff-4273-a9b0-df1620358ca4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:41.357923 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-03fb1e96-0aff-4273-a9b0-df1620358ca4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:41.358403 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-03fb1e96-0aff-4273-a9b0-df1620358ca4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:41.358876 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-03fb1e96-0aff-4273-a9b0-df1620358ca4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:41.359326 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.objects.instance [None req-03fb1e96-0aff-4273-a9b0-df1620358ca4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lazy-loading 'fault' on Instance uuid 1da39a54-b8f3-49a7-9447-497fadd2cefb {{(pid=127772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:59:41.397839 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-03fb1e96-0aff-4273-a9b0-df1620358ca4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:41.406335 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-03fb1e96-0aff-4273-a9b0-df1620358ca4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1332 microversion: 2.1 time: 0.092957 Sep 09 12:59:41.406941 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 183/362] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:41 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:41.753894 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-32451c60-e4a1-4bd2-8f95-7cc96f1ebcf9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:41.754523 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-32451c60-e4a1-4bd2-8f95-7cc96f1ebcf9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:41.761545 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-32451c60-e4a1-4bd2-8f95-7cc96f1ebcf9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:41.762029 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-32451c60-e4a1-4bd2-8f95-7cc96f1ebcf9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:41.762463 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-32451c60-e4a1-4bd2-8f95-7cc96f1ebcf9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:41.763165 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-32451c60-e4a1-4bd2-8f95-7cc96f1ebcf9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:41.763613 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-32451c60-e4a1-4bd2-8f95-7cc96f1ebcf9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:41.764035 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-32451c60-e4a1-4bd2-8f95-7cc96f1ebcf9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:41.898935 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-32451c60-e4a1-4bd2-8f95-7cc96f1ebcf9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:41.917082 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-32451c60-e4a1-4bd2-8f95-7cc96f1ebcf9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1514 microversion: 2.1 time: 0.167156 Sep 09 12:59:41.917657 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 180/363] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:41 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:41.956697 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-2d0065c3-11c7-4c3c-945c-5e9e0482ef07 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:41.957602 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-2d0065c3-11c7-4c3c-945c-5e9e0482ef07 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:41.965880 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2d0065c3-11c7-4c3c-945c-5e9e0482ef07 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:41.966431 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2d0065c3-11c7-4c3c-945c-5e9e0482ef07 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:41.967080 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2d0065c3-11c7-4c3c-945c-5e9e0482ef07 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:41.967786 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2d0065c3-11c7-4c3c-945c-5e9e0482ef07 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:41.968475 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2d0065c3-11c7-4c3c-945c-5e9e0482ef07 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:41.969169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2d0065c3-11c7-4c3c-945c-5e9e0482ef07 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:42.060829 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-e776da9d-7a5e-452d-bf21-4f361672503c req-6d1241c8-a8ff-4a9c-9cab-b3d45bae77a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87", "name": "network-vif-plugged", "status": "completed", "tag": "cded5ff7-f97f-40e2-a004-1b7adc01e3da"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:59:42.076926 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-e776da9d-7a5e-452d-bf21-4f361672503c req-6d1241c8-a8ff-4a9c-9cab-b3d45bae77a9 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:42.077539 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-e776da9d-7a5e-452d-bf21-4f361672503c req-6d1241c8-a8ff-4a9c-9cab-b3d45bae77a9 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:42.078043 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-e776da9d-7a5e-452d-bf21-4f361672503c req-6d1241c8-a8ff-4a9c-9cab-b3d45bae77a9 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:42.093127 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-e776da9d-7a5e-452d-bf21-4f361672503c req-6d1241c8-a8ff-4a9c-9cab-b3d45bae77a9 service nova] Creating event network-vif-plugged:cded5ff7-f97f-40e2-a004-1b7adc01e3da for instance c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 on hv-cinder-81322 Sep 09 12:59:42.098862 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-e776da9d-7a5e-452d-bf21-4f361672503c req-6d1241c8-a8ff-4a9c-9cab-b3d45bae77a9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045665 Sep 09 12:59:42.105639 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 181/364] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:59:42.115672 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-3d932df9-6062-4660-9735-ffbe17b04173 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:42.116472 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-3d932df9-6062-4660-9735-ffbe17b04173 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:42.125017 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3d932df9-6062-4660-9735-ffbe17b04173 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:42.125823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3d932df9-6062-4660-9735-ffbe17b04173 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:42.127186 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3d932df9-6062-4660-9735-ffbe17b04173 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:42.128516 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3d932df9-6062-4660-9735-ffbe17b04173 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:42.129162 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3d932df9-6062-4660-9735-ffbe17b04173 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:42.130547 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3d932df9-6062-4660-9735-ffbe17b04173 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:42.156462 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-2d0065c3-11c7-4c3c-945c-5e9e0482ef07 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:42.166024 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-2d0065c3-11c7-4c3c-945c-5e9e0482ef07 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:42.167741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-2d0065c3-11c7-4c3c-945c-5e9e0482ef07 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:42.168903 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-2d0065c3-11c7-4c3c-945c-5e9e0482ef07 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1795 microversion: 2.20 time: 0.217966 Sep 09 12:59:42.169715 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 184/365] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 12:59:41 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1795 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:59:42.174663 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7c021fee-5e64-4cdd-9e09-17dd5bb51524 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:42.175453 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7c021fee-5e64-4cdd-9e09-17dd5bb51524 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:42.183098 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7c021fee-5e64-4cdd-9e09-17dd5bb51524 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:42.183791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7c021fee-5e64-4cdd-9e09-17dd5bb51524 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:42.184408 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7c021fee-5e64-4cdd-9e09-17dd5bb51524 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:42.185285 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7c021fee-5e64-4cdd-9e09-17dd5bb51524 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:42.185893 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7c021fee-5e64-4cdd-9e09-17dd5bb51524 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:42.186542 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7c021fee-5e64-4cdd-9e09-17dd5bb51524 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:42.210260 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-3d932df9-6062-4660-9735-ffbe17b04173 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:42.218990 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-3d932df9-6062-4660-9735-ffbe17b04173 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1254 microversion: 2.1 time: 0.111660 Sep 09 12:59:42.226892 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 182/366] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:42 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1254 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:42.331002 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7c021fee-5e64-4cdd-9e09-17dd5bb51524 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:42.338928 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7c021fee-5e64-4cdd-9e09-17dd5bb51524 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1266 microversion: 2.1 time: 0.167889 Sep 09 12:59:42.339555 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 185/367] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:42 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:42.429193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-377b2a21-d11c-4eb5-8639-9fd1ea32b053 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:42.429812 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-377b2a21-d11c-4eb5-8639-9fd1ea32b053 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:42.436714 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-377b2a21-d11c-4eb5-8639-9fd1ea32b053 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:42.437198 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-377b2a21-d11c-4eb5-8639-9fd1ea32b053 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:42.437641 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-377b2a21-d11c-4eb5-8639-9fd1ea32b053 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:42.438337 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-377b2a21-d11c-4eb5-8639-9fd1ea32b053 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:42.438818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-377b2a21-d11c-4eb5-8639-9fd1ea32b053 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:42.439244 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-377b2a21-d11c-4eb5-8639-9fd1ea32b053 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:42.470854 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-377b2a21-d11c-4eb5-8639-9fd1ea32b053 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:42.471344 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-377b2a21-d11c-4eb5-8639-9fd1ea32b053 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:42.471788 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-377b2a21-d11c-4eb5-8639-9fd1ea32b053 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:42.472238 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.objects.instance [None req-377b2a21-d11c-4eb5-8639-9fd1ea32b053 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lazy-loading 'fault' on Instance uuid 1da39a54-b8f3-49a7-9447-497fadd2cefb {{(pid=127771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:59:42.526033 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-377b2a21-d11c-4eb5-8639-9fd1ea32b053 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:42.534222 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-377b2a21-d11c-4eb5-8639-9fd1ea32b053 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 200 len: 1332 microversion: 2.1 time: 0.108879 Sep 09 12:59:42.539888 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 183/368] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:42 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:43.241374 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-17aa19b4-8f8f-4f19-b3c4-92108c487e57 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:43.241894 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-17aa19b4-8f8f-4f19-b3c4-92108c487e57 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:43.248023 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-17aa19b4-8f8f-4f19-b3c4-92108c487e57 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:43.248504 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-17aa19b4-8f8f-4f19-b3c4-92108c487e57 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:43.249086 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-17aa19b4-8f8f-4f19-b3c4-92108c487e57 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:43.249668 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-17aa19b4-8f8f-4f19-b3c4-92108c487e57 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:43.250118 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-17aa19b4-8f8f-4f19-b3c4-92108c487e57 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:43.250569 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-17aa19b4-8f8f-4f19-b3c4-92108c487e57 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:43.312520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-17aa19b4-8f8f-4f19-b3c4-92108c487e57 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:43.320235 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-17aa19b4-8f8f-4f19-b3c4-92108c487e57 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1310 microversion: 2.1 time: 0.082873 Sep 09 12:59:43.320801 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 186/369] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:43 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:43.361174 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-21a7d3cb-c9bb-4ee8-8bb0-9372a62bfeca tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:43.361793 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-21a7d3cb-c9bb-4ee8-8bb0-9372a62bfeca tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:43.368229 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-21a7d3cb-c9bb-4ee8-8bb0-9372a62bfeca tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:43.369307 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-21a7d3cb-c9bb-4ee8-8bb0-9372a62bfeca tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:43.369752 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-21a7d3cb-c9bb-4ee8-8bb0-9372a62bfeca tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:43.370459 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-21a7d3cb-c9bb-4ee8-8bb0-9372a62bfeca tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:43.371522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-21a7d3cb-c9bb-4ee8-8bb0-9372a62bfeca tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:43.371956 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-21a7d3cb-c9bb-4ee8-8bb0-9372a62bfeca tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:43.506228 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-21a7d3cb-c9bb-4ee8-8bb0-9372a62bfeca tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:43.514676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-21a7d3cb-c9bb-4ee8-8bb0-9372a62bfeca tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1266 microversion: 2.1 time: 0.157351 Sep 09 12:59:43.515228 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 184/370] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:43 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:43.557901 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-409c7092-6e1c-4a79-9f13-99bd92fc4883 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:43.558554 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-409c7092-6e1c-4a79-9f13-99bd92fc4883 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:43.564511 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-409c7092-6e1c-4a79-9f13-99bd92fc4883 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:43.564994 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-409c7092-6e1c-4a79-9f13-99bd92fc4883 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:43.565431 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-409c7092-6e1c-4a79-9f13-99bd92fc4883 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:43.566120 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-409c7092-6e1c-4a79-9f13-99bd92fc4883 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:43.566616 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-409c7092-6e1c-4a79-9f13-99bd92fc4883 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:43.567027 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-409c7092-6e1c-4a79-9f13-99bd92fc4883 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:43.571461 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=100 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:43.582182 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-409c7092-6e1c-4a79-9f13-99bd92fc4883 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] HTTP exception thrown: Instance 1da39a54-b8f3-49a7-9447-497fadd2cefb could not be found. Sep 09 12:59:43.583874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-409c7092-6e1c-4a79-9f13-99bd92fc4883 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Request method failure captured: Sep 09 12:59:43.583874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb HTTP/1.1 Sep 09 12:59:43.583874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 12:59:43.583874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 12:59:43.583874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 12:59:43.583874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 12:59:43.583874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 12:59:43.583874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 12:59:43.583874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 12:59:43.583874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 12:59:43.583874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGzgEaKb6PZCqo9yxUSEJiFD1xb1LGODlWVgID9cA22eqBLNomTmu2q0yMgjccpW69nnUAUWKXMpFaG8X-sF87AhuIdLNOF9PvF4tjoZWf7SNwd1H5TWSvp_IUIt9lOp_NKX-JRPFLgnDrNAvr9jG5GRaXTb0sVN8rNo6hRRXay_HW10 Sep 09 12:59:43.583874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 12:59:43.583874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 12:59:43.583874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 12:59:43.583874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 12:59:43.583874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 12:59:43.583874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 12:59:43.583874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 12:59:43.583874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 12:59:43.583874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 12:59:43.583874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 12:59:43.585132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ceed6a1f0f4542cbafa4b2a46b16d5fb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}] Sep 09 12:59:43.585132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 12:59:43.585132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 12:59:43.585132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 12:59:43.585132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 12:59:43.585132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 12:59:43.585132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 12:59:43.585132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: 63a2902f465f4fd1aed80060c2669259 Sep 09 12:59:43.585132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 12:59:43.585132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: > Sep 09 12:59:43.585132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Instance 1da39a54-b8f3-49a7-9447-497fadd2cefb could not be found. Sep 09 12:59:43.585132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'id': '1da39a54-b8f3-49a7-9447-497fadd2cefb'} Sep 09 12:59:43.585933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:59:43.585933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:59:43.585933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:59:43.585933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:59:43.585933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:59:43.585933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:59:43.585933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:59:43.585933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:59:43.585933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:59:43.585933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:59:43.585933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1da39a54-b8f3-49a7-9447-497fadd2cefb could not be found. Sep 09 12:59:43.585933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:59:43.585933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:59:43.585933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:59:43.585933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:59:43.585933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:59:43.585933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:59:43.585933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:59:43.585933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:59:43.585933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:59:43.587508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:59:43.587508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:59:43.587508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:59:43.587508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:59:43.587508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:59:43.587508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:59:43.587508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:59:43.587508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1da39a54-b8f3-49a7-9447-497fadd2cefb could not be found. Sep 09 12:59:43.587508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:59:43.587508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:59:43.587508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:59:43.587508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:59:43.587508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:59:43.587508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:59:43.587508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:59:43.587508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:59:43.587508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1da39a54-b8f3-49a7-9447-497fadd2cefb could not be found. Sep 09 12:59:43.587508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 12:59:43.589332 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-409c7092-6e1c-4a79-9f13-99bd92fc4883 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Returning 404 to user: Instance 1da39a54-b8f3-49a7-9447-497fadd2cefb could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:59:43.589332 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-409c7092-6e1c-4a79-9f13-99bd92fc4883 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 404 len: 111 microversion: 2.1 time: 0.032238 Sep 09 12:59:43.589332 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 187/371] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:43 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:59:43.595058 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0e3cfbe4-d1ab-4227-aad3-900bab76f00a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '.version_select at 0x7f3183134310>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:43.640254 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c9cca12a-5731-4f07-8cd2-e5eb605422e4 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Action: 'create', calling method: .version_select at 0x7f318327c820>, body: {"keypair": {"name": "tempest-keypair-1327978060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfngWjIqd48dkglZbSGATwR/Etp3fgaH2tGaET6X9iojGwOkb11QtrFsSxCiRFDjHqFzqDlKV788d08w3HGTQyusI/1eini32/csaOQTtUIfzMU8YDtthwqjhomqgG5QA=="}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:59:43.656306 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-c9cca12a-5731-4f07-8cd2-e5eb605422e4 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Getting quotas for project bf202f6eebd442e988e0f7307950a6c8. Resources: {'key_pairs'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:59:43.660086 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-c9cca12a-5731-4f07-8cd2-e5eb605422e4 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Getting quotas for user 48f14caeb8f944c6aaf27913972869c7 and project bf202f6eebd442e988e0f7307950a6c8. Resources: {'key_pairs'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:59:43.682834 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0e3cfbe4-d1ab-4227-aad3-900bab76f00a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1701927809" status: 202 len: 0 microversion: 2.1 time: 0.091797 Sep 09 12:59:43.683433 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 185/372] 10.222.0.46 () {58 vars in 1221 bytes} [Fri Sep 9 12:59:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1701927809 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:59:43.774101 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-c9cca12a-5731-4f07-8cd2-e5eb605422e4 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.137642 Sep 09 12:59:43.774967 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 188/373] 10.222.0.46 () {60 vars in 1159 bytes} [Fri Sep 9 12:59:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:59:44.344364 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-f47b9030-ad2d-4269-a0c6-e9266d454970 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:44.344859 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-f47b9030-ad2d-4269-a0c6-e9266d454970 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:44.351273 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f47b9030-ad2d-4269-a0c6-e9266d454970 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:44.351816 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f47b9030-ad2d-4269-a0c6-e9266d454970 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:44.352370 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f47b9030-ad2d-4269-a0c6-e9266d454970 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:44.354318 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f47b9030-ad2d-4269-a0c6-e9266d454970 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:44.354814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f47b9030-ad2d-4269-a0c6-e9266d454970 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:44.355247 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f47b9030-ad2d-4269-a0c6-e9266d454970 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:44.445341 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-f47b9030-ad2d-4269-a0c6-e9266d454970 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:44.454519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-f47b9030-ad2d-4269-a0c6-e9266d454970 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1318 microversion: 2.1 time: 0.113957 Sep 09 12:59:44.455121 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 186/374] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:44 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1318 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:44.537614 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-aee9a729-d074-4fbe-aec1-167bbe479c69 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:44.538233 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-aee9a729-d074-4fbe-aec1-167bbe479c69 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:44.554628 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-aee9a729-d074-4fbe-aec1-167bbe479c69 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:44.555473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-aee9a729-d074-4fbe-aec1-167bbe479c69 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:44.555912 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-aee9a729-d074-4fbe-aec1-167bbe479c69 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:44.557796 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-aee9a729-d074-4fbe-aec1-167bbe479c69 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:44.558272 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-aee9a729-d074-4fbe-aec1-167bbe479c69 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:44.558743 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-aee9a729-d074-4fbe-aec1-167bbe479c69 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:44.886272 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-aee9a729-d074-4fbe-aec1-167bbe479c69 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:44.896442 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-aee9a729-d074-4fbe-aec1-167bbe479c69 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1454 microversion: 2.1 time: 0.362502 Sep 09 12:59:44.897659 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 189/375] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:44 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1454 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:44.921766 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-1baf74e3-a8ff-40fe-ae68-35e5337da695 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:44.922385 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-1baf74e3-a8ff-40fe-ae68-35e5337da695 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:44.928714 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1baf74e3-a8ff-40fe-ae68-35e5337da695 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:44.932397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1baf74e3-a8ff-40fe-ae68-35e5337da695 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:44.932397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1baf74e3-a8ff-40fe-ae68-35e5337da695 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:44.933089 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1baf74e3-a8ff-40fe-ae68-35e5337da695 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:44.934214 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1baf74e3-a8ff-40fe-ae68-35e5337da695 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:44.934756 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1baf74e3-a8ff-40fe-ae68-35e5337da695 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:45.044013 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-29b59c66-50f3-421e-a310-5709225aeb66 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:45.044944 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-29b59c66-50f3-421e-a310-5709225aeb66 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:45.051947 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-29b59c66-50f3-421e-a310-5709225aeb66 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:45.052746 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-29b59c66-50f3-421e-a310-5709225aeb66 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:45.053633 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-29b59c66-50f3-421e-a310-5709225aeb66 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:45.054630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-29b59c66-50f3-421e-a310-5709225aeb66 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:45.055064 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-29b59c66-50f3-421e-a310-5709225aeb66 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:45.057494 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-29b59c66-50f3-421e-a310-5709225aeb66 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:45.150959 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=2 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:45.153851 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-1baf74e3-a8ff-40fe-ae68-35e5337da695 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:45.161685 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-1baf74e3-a8ff-40fe-ae68-35e5337da695 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1454 microversion: 2.1 time: 0.243674 Sep 09 12:59:45.170645 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 187/376] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:44 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1454 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:45.207766 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.objects.instance [None req-29b59c66-50f3-421e-a310-5709225aeb66 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lazy-loading 'services' on Instance uuid 7f59545d-0b40-4f82-94e2-789c728a6bed {{(pid=127772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:59:45.480048 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-dc966409-834a-432d-b475-5f20184dc233 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:45.480661 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-dc966409-834a-432d-b475-5f20184dc233 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:45.484907 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=2 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:45.502893 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dc966409-834a-432d-b475-5f20184dc233 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:45.504229 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dc966409-834a-432d-b475-5f20184dc233 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:45.506904 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dc966409-834a-432d-b475-5f20184dc233 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:45.506904 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dc966409-834a-432d-b475-5f20184dc233 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:45.506904 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dc966409-834a-432d-b475-5f20184dc233 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:45.506904 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dc966409-834a-432d-b475-5f20184dc233 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:45.599301 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-29b59c66-50f3-421e-a310-5709225aeb66 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments/ab711164-1a6a-4f8f-b353-5b028bbcb8da" status: 202 len: 0 microversion: 2.1 time: 0.559572 Sep 09 12:59:45.601129 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 190/377] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 12:59:45 2022] DELETE /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments/ab711164-1a6a-4f8f-b353-5b028bbcb8da => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:59:45.615134 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-eeb783d0-7252-49dc-a651-5345cca1a40f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:45.621905 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-eeb783d0-7252-49dc-a651-5345cca1a40f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:45.635723 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-eeb783d0-7252-49dc-a651-5345cca1a40f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:45.637702 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-eeb783d0-7252-49dc-a651-5345cca1a40f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:45.637702 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-eeb783d0-7252-49dc-a651-5345cca1a40f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:45.637878 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-eeb783d0-7252-49dc-a651-5345cca1a40f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:45.638321 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-eeb783d0-7252-49dc-a651-5345cca1a40f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:45.646270 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-eeb783d0-7252-49dc-a651-5345cca1a40f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:45.698119 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-eeb783d0-7252-49dc-a651-5345cca1a40f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090487 Sep 09 12:59:45.699521 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 191/378] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 12:59:45 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:59:45.719800 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-dc966409-834a-432d-b475-5f20184dc233 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:45.738542 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-dc966409-834a-432d-b475-5f20184dc233 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1316 microversion: 2.1 time: 0.262608 Sep 09 12:59:45.751113 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 188/379] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:45 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1316 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:46.711099 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-59bc71a5-0960-45fc-a762-6630941298ac tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:46.716852 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-59bc71a5-0960-45fc-a762-6630941298ac tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:46.733125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-59bc71a5-0960-45fc-a762-6630941298ac tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:46.735066 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-59bc71a5-0960-45fc-a762-6630941298ac tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:46.735875 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-59bc71a5-0960-45fc-a762-6630941298ac tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:46.737049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-59bc71a5-0960-45fc-a762-6630941298ac tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:46.737687 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-59bc71a5-0960-45fc-a762-6630941298ac tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:46.738400 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-59bc71a5-0960-45fc-a762-6630941298ac tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:46.769038 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-57891d79-8273-4e5d-a88c-f1a2adff4c59 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:46.769656 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-57891d79-8273-4e5d-a88c-f1a2adff4c59 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:46.786926 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-57891d79-8273-4e5d-a88c-f1a2adff4c59 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:46.787706 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-57891d79-8273-4e5d-a88c-f1a2adff4c59 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:46.788325 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-57891d79-8273-4e5d-a88c-f1a2adff4c59 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:46.789204 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-57891d79-8273-4e5d-a88c-f1a2adff4c59 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:46.789822 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-57891d79-8273-4e5d-a88c-f1a2adff4c59 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:46.790445 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-57891d79-8273-4e5d-a88c-f1a2adff4c59 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:46.792565 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-59bc71a5-0960-45fc-a762-6630941298ac tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085653 Sep 09 12:59:46.795518 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 192/380] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 12:59:46 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:59:47.058422 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-57891d79-8273-4e5d-a88c-f1a2adff4c59 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:47.066207 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-57891d79-8273-4e5d-a88c-f1a2adff4c59 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1358 microversion: 2.1 time: 0.300937 Sep 09 12:59:47.067460 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 189/381] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:46 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1358 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:47.763089 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-41190362-aead-4c60-b846-c0601d2dfb66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-835142849", "imageRef": "355bded2-2225-44b2-af86-f9e1861d05ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac3b6ddd-d129-4d56-86ba-2ef788442f94"}], "security_groups": [{"name": "tempest-securitygroup--490554405"}], "key_name": "tempest-keypair-1327978060", "user_data": "}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:59:47.809434 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ff5cd680-db59-45df-8435-434216fb31ad tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:47.812693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ff5cd680-db59-45df-8435-434216fb31ad tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:47.825298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff5cd680-db59-45df-8435-434216fb31ad tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:47.826546 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff5cd680-db59-45df-8435-434216fb31ad tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:47.835661 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff5cd680-db59-45df-8435-434216fb31ad tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:47.838199 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff5cd680-db59-45df-8435-434216fb31ad tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:47.843229 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff5cd680-db59-45df-8435-434216fb31ad tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:47.844129 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff5cd680-db59-45df-8435-434216fb31ad tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:47.918521 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ff5cd680-db59-45df-8435-434216fb31ad tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113416 Sep 09 12:59:47.925020 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 190/382] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 12:59:47 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:59:47.934073 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.network.neutron [None req-41190362-aead-4c60-b846-c0601d2dfb66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] validate_networks() for [('ac3b6ddd-d129-4d56-86ba-2ef788442f94', None, None, None, None, None)] {{(pid=127772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:59:48.091144 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-78eba64e-16dd-42a6-a57d-37e2c0bcd862 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:48.091927 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-78eba64e-16dd-42a6-a57d-37e2c0bcd862 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:48.104840 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-78eba64e-16dd-42a6-a57d-37e2c0bcd862 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:48.109121 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-78eba64e-16dd-42a6-a57d-37e2c0bcd862 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:48.109121 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-78eba64e-16dd-42a6-a57d-37e2c0bcd862 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:48.109121 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-78eba64e-16dd-42a6-a57d-37e2c0bcd862 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:48.109586 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-78eba64e-16dd-42a6-a57d-37e2c0bcd862 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:48.110361 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-78eba64e-16dd-42a6-a57d-37e2c0bcd862 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:48.428299 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-78eba64e-16dd-42a6-a57d-37e2c0bcd862 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:48.439619 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-78eba64e-16dd-42a6-a57d-37e2c0bcd862 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1358 microversion: 2.1 time: 0.354209 Sep 09 12:59:48.440433 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 191/383] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:48 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1358 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:48.501860 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-41190362-aead-4c60-b846-c0601d2dfb66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Flavor limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:59:48.502834 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-41190362-aead-4c60-b846-c0601d2dfb66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Image limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:59:48.503589 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-41190362-aead-4c60-b846-c0601d2dfb66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Flavor pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:59:48.504141 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-41190362-aead-4c60-b846-c0601d2dfb66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Image pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:59:48.504796 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-41190362-aead-4c60-b846-c0601d2dfb66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:59:48.516557 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-41190362-aead-4c60-b846-c0601d2dfb66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:48.517461 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-41190362-aead-4c60-b846-c0601d2dfb66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:48.518112 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-41190362-aead-4c60-b846-c0601d2dfb66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:48.519044 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-41190362-aead-4c60-b846-c0601d2dfb66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:48.520022 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-41190362-aead-4c60-b846-c0601d2dfb66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:48.520140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-41190362-aead-4c60-b846-c0601d2dfb66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:48.538763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-41190362-aead-4c60-b846-c0601d2dfb66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Getting quotas for project bf202f6eebd442e988e0f7307950a6c8. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:59:48.543245 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-41190362-aead-4c60-b846-c0601d2dfb66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Getting quotas for user 48f14caeb8f944c6aaf27913972869c7 and project bf202f6eebd442e988e0f7307950a6c8. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:59:48.556321 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-41190362-aead-4c60-b846-c0601d2dfb66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Going to run 1 instances... {{(pid=127772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:59:48.558776 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-41190362-aead-4c60-b846-c0601d2dfb66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='355bded2-2225-44b2-af86-f9e1861d05ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:59:48.688732 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-41190362-aead-4c60-b846-c0601d2dfb66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.930734 Sep 09 12:59:48.689710 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 193/384] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 12:59:47 2022] POST /compute/v2.1/servers => generated 408 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:59:48.701737 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-b8fa0a9d-2ca4-4e5a-9974-11431fc1ea1d tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:48.702369 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-b8fa0a9d-2ca4-4e5a-9974-11431fc1ea1d tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:48.722935 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:48.807158 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-b8fa0a9d-2ca4-4e5a-9974-11431fc1ea1d tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:48.816937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-b8fa0a9d-2ca4-4e5a-9974-11431fc1ea1d tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1245 microversion: 2.1 time: 0.119671 Sep 09 12:59:48.818748 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 192/385] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:48 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1245 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:48.939806 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-54a9815f-8c81-46b0-a5c5-1e1891d299af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:48.942249 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-54a9815f-8c81-46b0-a5c5-1e1891d299af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:48.955748 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-54a9815f-8c81-46b0-a5c5-1e1891d299af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:48.956500 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-54a9815f-8c81-46b0-a5c5-1e1891d299af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:48.962781 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-54a9815f-8c81-46b0-a5c5-1e1891d299af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:48.962781 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-54a9815f-8c81-46b0-a5c5-1e1891d299af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:48.962781 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-54a9815f-8c81-46b0-a5c5-1e1891d299af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:48.962781 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-54a9815f-8c81-46b0-a5c5-1e1891d299af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:48.996336 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-54a9815f-8c81-46b0-a5c5-1e1891d299af tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061513 Sep 09 12:59:49.001150 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 194/386] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 12:59:48 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:59:49.131704 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-6de8eac5-eb3b-47e6-8f01-2fee17695428 req-fb4eaa3e-482c-401b-ad92-91d87ac1a83a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87", "tag": "cded5ff7-f97f-40e2-a004-1b7adc01e3da"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:59:49.143001 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-6de8eac5-eb3b-47e6-8f01-2fee17695428 req-fb4eaa3e-482c-401b-ad92-91d87ac1a83a service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:49.143488 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-6de8eac5-eb3b-47e6-8f01-2fee17695428 req-fb4eaa3e-482c-401b-ad92-91d87ac1a83a service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:49.143980 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-6de8eac5-eb3b-47e6-8f01-2fee17695428 req-fb4eaa3e-482c-401b-ad92-91d87ac1a83a service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:49.174466 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-6de8eac5-eb3b-47e6-8f01-2fee17695428 req-fb4eaa3e-482c-401b-ad92-91d87ac1a83a service nova] Creating event network-changed:cded5ff7-f97f-40e2-a004-1b7adc01e3da for instance c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 on hv-cinder-81322 Sep 09 12:59:49.180545 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-6de8eac5-eb3b-47e6-8f01-2fee17695428 req-fb4eaa3e-482c-401b-ad92-91d87ac1a83a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052380 Sep 09 12:59:49.189366 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 193/387] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:59:49.469160 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-f5efa4b5-0be3-4c8e-bdfc-5e93918b897f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:49.469973 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-f5efa4b5-0be3-4c8e-bdfc-5e93918b897f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:49.477944 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f5efa4b5-0be3-4c8e-bdfc-5e93918b897f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:49.478869 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f5efa4b5-0be3-4c8e-bdfc-5e93918b897f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:49.479630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f5efa4b5-0be3-4c8e-bdfc-5e93918b897f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:49.480871 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f5efa4b5-0be3-4c8e-bdfc-5e93918b897f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:49.481724 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f5efa4b5-0be3-4c8e-bdfc-5e93918b897f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:49.482316 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f5efa4b5-0be3-4c8e-bdfc-5e93918b897f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:49.652428 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-f5efa4b5-0be3-4c8e-bdfc-5e93918b897f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:49.663688 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-f5efa4b5-0be3-4c8e-bdfc-5e93918b897f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1358 microversion: 2.1 time: 0.199658 Sep 09 12:59:49.666693 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 195/388] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:49 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:49.845812 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8d1f4b54-f8f5-4a3b-ba32-3bbfab80f4bc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:49.847343 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-8d1f4b54-f8f5-4a3b-ba32-3bbfab80f4bc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:49.859360 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8d1f4b54-f8f5-4a3b-ba32-3bbfab80f4bc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:49.862849 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8d1f4b54-f8f5-4a3b-ba32-3bbfab80f4bc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:49.864401 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8d1f4b54-f8f5-4a3b-ba32-3bbfab80f4bc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:49.866846 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8d1f4b54-f8f5-4a3b-ba32-3bbfab80f4bc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:49.868389 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8d1f4b54-f8f5-4a3b-ba32-3bbfab80f4bc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:49.869101 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8d1f4b54-f8f5-4a3b-ba32-3bbfab80f4bc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:49.957491 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-8d1f4b54-f8f5-4a3b-ba32-3bbfab80f4bc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:49.969025 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-8d1f4b54-f8f5-4a3b-ba32-3bbfab80f4bc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1249 microversion: 2.1 time: 0.127767 Sep 09 12:59:49.978984 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 194/389] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:49 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1249 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:50.010515 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-78745e4d-6b5f-4c26-94b1-6c38c03a74ab tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:50.012731 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-78745e4d-6b5f-4c26-94b1-6c38c03a74ab tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:50.019370 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-78745e4d-6b5f-4c26-94b1-6c38c03a74ab tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:50.019859 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-78745e4d-6b5f-4c26-94b1-6c38c03a74ab tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:50.020299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-78745e4d-6b5f-4c26-94b1-6c38c03a74ab tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:50.021007 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-78745e4d-6b5f-4c26-94b1-6c38c03a74ab tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:50.021648 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-78745e4d-6b5f-4c26-94b1-6c38c03a74ab tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:50.022393 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-78745e4d-6b5f-4c26-94b1-6c38c03a74ab tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:50.057858 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-78745e4d-6b5f-4c26-94b1-6c38c03a74ab tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052490 Sep 09 12:59:50.059282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 196/390] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 12:59:50 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:59:50.687308 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8fd3d5a1-4c17-4cd2-8818-0c74cce91bc9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:50.688357 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-8fd3d5a1-4c17-4cd2-8818-0c74cce91bc9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:50.695098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8fd3d5a1-4c17-4cd2-8818-0c74cce91bc9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:50.695822 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8fd3d5a1-4c17-4cd2-8818-0c74cce91bc9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:50.697082 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8fd3d5a1-4c17-4cd2-8818-0c74cce91bc9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:50.700145 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8fd3d5a1-4c17-4cd2-8818-0c74cce91bc9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:50.700145 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8fd3d5a1-4c17-4cd2-8818-0c74cce91bc9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:50.700145 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8fd3d5a1-4c17-4cd2-8818-0c74cce91bc9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:50.846420 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-8fd3d5a1-4c17-4cd2-8818-0c74cce91bc9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:50.854507 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-8fd3d5a1-4c17-4cd2-8818-0c74cce91bc9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1358 microversion: 2.1 time: 0.171083 Sep 09 12:59:50.855090 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 195/391] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:50 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:50.995101 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-3e318fc7-0ae3-491f-8185-0b1a92250522 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:50.995866 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-3e318fc7-0ae3-491f-8185-0b1a92250522 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:51.003886 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3e318fc7-0ae3-491f-8185-0b1a92250522 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:51.004376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3e318fc7-0ae3-491f-8185-0b1a92250522 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:51.004811 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3e318fc7-0ae3-491f-8185-0b1a92250522 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:51.005547 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3e318fc7-0ae3-491f-8185-0b1a92250522 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:51.005995 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3e318fc7-0ae3-491f-8185-0b1a92250522 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:51.006414 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3e318fc7-0ae3-491f-8185-0b1a92250522 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:51.070004 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-b2968762-f66c-4183-86c4-8b5a73dba30f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:51.070396 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-3e318fc7-0ae3-491f-8185-0b1a92250522 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:51.073252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-b2968762-f66c-4183-86c4-8b5a73dba30f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:51.079410 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b2968762-f66c-4183-86c4-8b5a73dba30f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:51.079569 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-3e318fc7-0ae3-491f-8185-0b1a92250522 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1249 microversion: 2.1 time: 0.088479 Sep 09 12:59:51.080057 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 197/392] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:50 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:51.080360 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b2968762-f66c-4183-86c4-8b5a73dba30f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:51.080824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b2968762-f66c-4183-86c4-8b5a73dba30f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:51.081723 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b2968762-f66c-4183-86c4-8b5a73dba30f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:51.082175 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b2968762-f66c-4183-86c4-8b5a73dba30f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:51.082624 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b2968762-f66c-4183-86c4-8b5a73dba30f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:51.132501 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-b2968762-f66c-4183-86c4-8b5a73dba30f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066822 Sep 09 12:59:51.133525 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 196/393] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 12:59:51 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:59:51.877554 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-6c018d2d-bdd3-426d-b363-cc3cde57b132 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:51.878179 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-6c018d2d-bdd3-426d-b363-cc3cde57b132 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:51.884464 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6c018d2d-bdd3-426d-b363-cc3cde57b132 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:51.884968 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6c018d2d-bdd3-426d-b363-cc3cde57b132 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:51.885412 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6c018d2d-bdd3-426d-b363-cc3cde57b132 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:51.886124 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6c018d2d-bdd3-426d-b363-cc3cde57b132 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:51.886606 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6c018d2d-bdd3-426d-b363-cc3cde57b132 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:51.887042 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6c018d2d-bdd3-426d-b363-cc3cde57b132 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:52.034919 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-6c018d2d-bdd3-426d-b363-cc3cde57b132 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:52.044677 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-6c018d2d-bdd3-426d-b363-cc3cde57b132 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1358 microversion: 2.1 time: 0.170908 Sep 09 12:59:52.051347 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 198/394] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:51 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:52.110004 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-bef91e1c-6f13-4264-8d7f-f94eeb12135b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:52.111898 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-bef91e1c-6f13-4264-8d7f-f94eeb12135b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:52.121022 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bef91e1c-6f13-4264-8d7f-f94eeb12135b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:52.122319 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bef91e1c-6f13-4264-8d7f-f94eeb12135b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:52.123313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bef91e1c-6f13-4264-8d7f-f94eeb12135b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:52.196162 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bef91e1c-6f13-4264-8d7f-f94eeb12135b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:52.196162 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bef91e1c-6f13-4264-8d7f-f94eeb12135b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:52.196162 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bef91e1c-6f13-4264-8d7f-f94eeb12135b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:52.197168 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-d87079cd-3a97-4382-b6dc-96337748c07e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:52.197168 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-d87079cd-3a97-4382-b6dc-96337748c07e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:52.197718 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=100 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:52.197805 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d87079cd-3a97-4382-b6dc-96337748c07e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:52.197805 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d87079cd-3a97-4382-b6dc-96337748c07e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:52.197805 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d87079cd-3a97-4382-b6dc-96337748c07e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:52.197805 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d87079cd-3a97-4382-b6dc-96337748c07e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:52.198141 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d87079cd-3a97-4382-b6dc-96337748c07e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:52.198141 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d87079cd-3a97-4382-b6dc-96337748c07e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:52.198141 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-d87079cd-3a97-4382-b6dc-96337748c07e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049532 Sep 09 12:59:52.198141 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 199/395] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 12:59:52 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:59:52.202320 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-bef91e1c-6f13-4264-8d7f-f94eeb12135b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:52.215029 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-bef91e1c-6f13-4264-8d7f-f94eeb12135b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1249 microversion: 2.1 time: 0.109011 Sep 09 12:59:52.215633 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 197/396] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:52 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1249 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:53.067717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7c5a0d92-9680-41e4-a357-0567ea6c6a5d tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:53.068361 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7c5a0d92-9680-41e4-a357-0567ea6c6a5d tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:53.075310 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7c5a0d92-9680-41e4-a357-0567ea6c6a5d tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:53.075798 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7c5a0d92-9680-41e4-a357-0567ea6c6a5d tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:53.076237 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7c5a0d92-9680-41e4-a357-0567ea6c6a5d tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:53.076942 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7c5a0d92-9680-41e4-a357-0567ea6c6a5d tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:53.077396 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7c5a0d92-9680-41e4-a357-0567ea6c6a5d tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:53.077839 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7c5a0d92-9680-41e4-a357-0567ea6c6a5d tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:53.204684 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-eea9689a-c856-40d9-af99-654d5348b49f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:53.206588 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-eea9689a-c856-40d9-af99-654d5348b49f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:53.206865 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7c5a0d92-9680-41e4-a357-0567ea6c6a5d tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:53.214292 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-eea9689a-c856-40d9-af99-654d5348b49f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:53.214819 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-eea9689a-c856-40d9-af99-654d5348b49f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:53.215247 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7c5a0d92-9680-41e4-a357-0567ea6c6a5d tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1358 microversion: 2.1 time: 0.151336 Sep 09 12:59:53.215357 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-eea9689a-c856-40d9-af99-654d5348b49f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:53.215821 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 200/397] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:53 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:53.216034 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-eea9689a-c856-40d9-af99-654d5348b49f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:53.216544 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-eea9689a-c856-40d9-af99-654d5348b49f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:53.216976 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-eea9689a-c856-40d9-af99-654d5348b49f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:53.241020 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-b8c4d09d-732a-4483-bde9-9157377286a2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:53.247886 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-b8c4d09d-732a-4483-bde9-9157377286a2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:53.247886 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b8c4d09d-732a-4483-bde9-9157377286a2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:53.248153 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-eea9689a-c856-40d9-af99-654d5348b49f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047992 Sep 09 12:59:53.248283 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b8c4d09d-732a-4483-bde9-9157377286a2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:53.248657 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b8c4d09d-732a-4483-bde9-9157377286a2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:53.249034 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 198/398] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 12:59:53 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:59:53.249359 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b8c4d09d-732a-4483-bde9-9157377286a2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:53.249817 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b8c4d09d-732a-4483-bde9-9157377286a2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:53.250242 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b8c4d09d-732a-4483-bde9-9157377286a2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:53.310907 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-b8c4d09d-732a-4483-bde9-9157377286a2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:53.318630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-b8c4d09d-732a-4483-bde9-9157377286a2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1249 microversion: 2.1 time: 0.081440 Sep 09 12:59:53.319297 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 201/399] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:53 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:54.238888 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d2746c6b-1a5e-454a-b56b-8e4292dd3ef3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:54.240147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-d2746c6b-1a5e-454a-b56b-8e4292dd3ef3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:54.247918 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d2746c6b-1a5e-454a-b56b-8e4292dd3ef3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:54.248880 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d2746c6b-1a5e-454a-b56b-8e4292dd3ef3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:54.248880 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d2746c6b-1a5e-454a-b56b-8e4292dd3ef3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:54.249585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d2746c6b-1a5e-454a-b56b-8e4292dd3ef3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:54.250044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d2746c6b-1a5e-454a-b56b-8e4292dd3ef3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:54.250475 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d2746c6b-1a5e-454a-b56b-8e4292dd3ef3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:54.261761 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-69e64816-1ca2-4cfb-818b-61c82ea5ed97 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:54.264791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-69e64816-1ca2-4cfb-818b-61c82ea5ed97 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:54.271758 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-69e64816-1ca2-4cfb-818b-61c82ea5ed97 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:54.272246 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-69e64816-1ca2-4cfb-818b-61c82ea5ed97 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:54.273005 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-69e64816-1ca2-4cfb-818b-61c82ea5ed97 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:54.273706 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-69e64816-1ca2-4cfb-818b-61c82ea5ed97 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:54.274824 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-69e64816-1ca2-4cfb-818b-61c82ea5ed97 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:54.275433 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-69e64816-1ca2-4cfb-818b-61c82ea5ed97 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:54.315943 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-69e64816-1ca2-4cfb-818b-61c82ea5ed97 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058981 Sep 09 12:59:54.316877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 202/400] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 12:59:54 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:59:54.343020 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-08f0af7d-6c24-445d-9560-4d70570591de tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:54.343637 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-08f0af7d-6c24-445d-9560-4d70570591de tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:54.351771 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-08f0af7d-6c24-445d-9560-4d70570591de tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:54.357782 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-08f0af7d-6c24-445d-9560-4d70570591de tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:54.357782 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-08f0af7d-6c24-445d-9560-4d70570591de tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:54.357782 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-08f0af7d-6c24-445d-9560-4d70570591de tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:54.357782 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-08f0af7d-6c24-445d-9560-4d70570591de tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:54.358197 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-08f0af7d-6c24-445d-9560-4d70570591de tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:54.402111 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-d2746c6b-1a5e-454a-b56b-8e4292dd3ef3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:54.410618 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d2746c6b-1a5e-454a-b56b-8e4292dd3ef3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1358 microversion: 2.1 time: 0.175006 Sep 09 12:59:54.419081 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 199/401] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:54 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:54.445016 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-08f0af7d-6c24-445d-9560-4d70570591de tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:54.454726 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-08f0af7d-6c24-445d-9560-4d70570591de tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1297 microversion: 2.1 time: 0.116740 Sep 09 12:59:54.455828 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 203/402] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:54 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1297 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:54.806512 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-2f18517f-e575-47bd-8ec3-47e0e50fe155 req-71a28681-4ec0-4183-8c2c-f869551e00c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c", "tag": "0f732f85-125a-41ad-8d5f-adfe587313de"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:59:54.815921 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-2f18517f-e575-47bd-8ec3-47e0e50fe155 req-71a28681-4ec0-4183-8c2c-f869551e00c8 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:54.816482 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-2f18517f-e575-47bd-8ec3-47e0e50fe155 req-71a28681-4ec0-4183-8c2c-f869551e00c8 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:54.817107 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-2f18517f-e575-47bd-8ec3-47e0e50fe155 req-71a28681-4ec0-4183-8c2c-f869551e00c8 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:54.830466 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-2f18517f-e575-47bd-8ec3-47e0e50fe155 req-71a28681-4ec0-4183-8c2c-f869551e00c8 service nova] Creating event network-changed:0f732f85-125a-41ad-8d5f-adfe587313de for instance 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c on hv-cinder-81322 Sep 09 12:59:54.835466 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-2f18517f-e575-47bd-8ec3-47e0e50fe155 req-71a28681-4ec0-4183-8c2c-f869551e00c8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033242 Sep 09 12:59:54.836060 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 200/403] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:59:55.329659 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-381683b4-8094-4878-8eaf-a041b8fa05ce tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:55.332806 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-381683b4-8094-4878-8eaf-a041b8fa05ce tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:55.340244 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-381683b4-8094-4878-8eaf-a041b8fa05ce tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:55.340992 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-381683b4-8094-4878-8eaf-a041b8fa05ce tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:55.341484 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-381683b4-8094-4878-8eaf-a041b8fa05ce tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:55.342694 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-381683b4-8094-4878-8eaf-a041b8fa05ce tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:55.343312 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-381683b4-8094-4878-8eaf-a041b8fa05ce tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:55.343887 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-381683b4-8094-4878-8eaf-a041b8fa05ce tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:55.377099 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-381683b4-8094-4878-8eaf-a041b8fa05ce tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052169 Sep 09 12:59:55.377854 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 204/404] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 12:59:55 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 12:59:55.445789 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-89477ac8-e8aa-449c-8349-281b3a1a1331 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:55.446762 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-89477ac8-e8aa-449c-8349-281b3a1a1331 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:55.450657 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-b8ac02cb-3308-438c-83e2-504abb555adb tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:55.451184 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-b8ac02cb-3308-438c-83e2-504abb555adb tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:55.453565 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-89477ac8-e8aa-449c-8349-281b3a1a1331 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:55.454058 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-89477ac8-e8aa-449c-8349-281b3a1a1331 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:55.455036 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-89477ac8-e8aa-449c-8349-281b3a1a1331 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:55.455994 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-89477ac8-e8aa-449c-8349-281b3a1a1331 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:55.456604 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-89477ac8-e8aa-449c-8349-281b3a1a1331 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:55.457227 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-89477ac8-e8aa-449c-8349-281b3a1a1331 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:55.464360 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b8ac02cb-3308-438c-83e2-504abb555adb tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:55.464862 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b8ac02cb-3308-438c-83e2-504abb555adb tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:55.465300 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b8ac02cb-3308-438c-83e2-504abb555adb tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:55.466010 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b8ac02cb-3308-438c-83e2-504abb555adb tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:55.466468 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b8ac02cb-3308-438c-83e2-504abb555adb tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:55.466926 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b8ac02cb-3308-438c-83e2-504abb555adb tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:55.515671 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:55.521152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-b8ac02cb-3308-438c-83e2-504abb555adb tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Going to try to terminate instance {{(pid=127772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:59:55.607769 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-89477ac8-e8aa-449c-8349-281b3a1a1331 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:55.616429 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-89477ac8-e8aa-449c-8349-281b3a1a1331 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1358 microversion: 2.1 time: 0.176710 Sep 09 12:59:55.617244 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 201/405] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:55 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:55.627289 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-14a0ee12-d868-4e50-b3a5-6d046ad4072b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:55.628802 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-14a0ee12-d868-4e50-b3a5-6d046ad4072b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:55.640726 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-14a0ee12-d868-4e50-b3a5-6d046ad4072b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:55.641714 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-14a0ee12-d868-4e50-b3a5-6d046ad4072b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:55.642226 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-14a0ee12-d868-4e50-b3a5-6d046ad4072b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:55.643109 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-14a0ee12-d868-4e50-b3a5-6d046ad4072b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:55.643774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-14a0ee12-d868-4e50-b3a5-6d046ad4072b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:55.644290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-14a0ee12-d868-4e50-b3a5-6d046ad4072b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:55.713930 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-14a0ee12-d868-4e50-b3a5-6d046ad4072b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:55.722189 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-14a0ee12-d868-4e50-b3a5-6d046ad4072b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1303 microversion: 2.1 time: 0.103634 Sep 09 12:59:55.724121 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 202/406] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:55 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:55.830091 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-b8ac02cb-3308-438c-83e2-504abb555adb tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 204 len: 0 microversion: 2.1 time: 0.383462 Sep 09 12:59:55.830819 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 205/407] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 12:59:55 2022] DELETE /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 12:59:55.839630 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-b4cdf2f4-3e20-4203-b3ce-429243c796d2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:55.840238 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-b4cdf2f4-3e20-4203-b3ce-429243c796d2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:55.846207 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b4cdf2f4-3e20-4203-b3ce-429243c796d2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:55.846988 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b4cdf2f4-3e20-4203-b3ce-429243c796d2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:55.847294 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b4cdf2f4-3e20-4203-b3ce-429243c796d2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:55.847987 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b4cdf2f4-3e20-4203-b3ce-429243c796d2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:55.848437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b4cdf2f4-3e20-4203-b3ce-429243c796d2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:55.848857 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b4cdf2f4-3e20-4203-b3ce-429243c796d2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:55.984063 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-b4cdf2f4-3e20-4203-b3ce-429243c796d2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:55.991797 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-b4cdf2f4-3e20-4203-b3ce-429243c796d2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1682 microversion: 2.1 time: 0.156766 Sep 09 12:59:55.994616 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 203/408] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:55 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:56.640846 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e8ea9143-9fc6-4421-8f51-4dab08d767a0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:56.641585 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e8ea9143-9fc6-4421-8f51-4dab08d767a0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:56.648306 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e8ea9143-9fc6-4421-8f51-4dab08d767a0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:56.648790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e8ea9143-9fc6-4421-8f51-4dab08d767a0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:56.649229 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e8ea9143-9fc6-4421-8f51-4dab08d767a0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:56.649922 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e8ea9143-9fc6-4421-8f51-4dab08d767a0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:56.650376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e8ea9143-9fc6-4421-8f51-4dab08d767a0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:56.650825 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e8ea9143-9fc6-4421-8f51-4dab08d767a0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:56.745065 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-1b3fc717-8d8f-49ac-8e62-1e5b26f14167 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:56.745675 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-1b3fc717-8d8f-49ac-8e62-1e5b26f14167 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:56.753234 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1b3fc717-8d8f-49ac-8e62-1e5b26f14167 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:56.753726 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1b3fc717-8d8f-49ac-8e62-1e5b26f14167 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:56.754166 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1b3fc717-8d8f-49ac-8e62-1e5b26f14167 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:56.754896 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1b3fc717-8d8f-49ac-8e62-1e5b26f14167 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:56.755352 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1b3fc717-8d8f-49ac-8e62-1e5b26f14167 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:56.755784 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1b3fc717-8d8f-49ac-8e62-1e5b26f14167 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:56.784210 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e8ea9143-9fc6-4421-8f51-4dab08d767a0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:56.792886 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e8ea9143-9fc6-4421-8f51-4dab08d767a0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1358 microversion: 2.1 time: 0.155574 Sep 09 12:59:56.793734 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 206/409] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:56 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:56.882329 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-1b3fc717-8d8f-49ac-8e62-1e5b26f14167 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:56.890717 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-1b3fc717-8d8f-49ac-8e62-1e5b26f14167 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1370 microversion: 2.1 time: 0.149509 Sep 09 12:59:56.891277 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 204/410] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:56 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:57.015087 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-bfc4ee8d-9d9d-4b01-a6a7-59ffdea93a88 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:57.015617 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-bfc4ee8d-9d9d-4b01-a6a7-59ffdea93a88 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:57.021682 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bfc4ee8d-9d9d-4b01-a6a7-59ffdea93a88 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:57.022176 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bfc4ee8d-9d9d-4b01-a6a7-59ffdea93a88 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:57.022648 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bfc4ee8d-9d9d-4b01-a6a7-59ffdea93a88 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:57.023345 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bfc4ee8d-9d9d-4b01-a6a7-59ffdea93a88 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:57.023803 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bfc4ee8d-9d9d-4b01-a6a7-59ffdea93a88 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:57.024232 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bfc4ee8d-9d9d-4b01-a6a7-59ffdea93a88 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:57.153029 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-bfc4ee8d-9d9d-4b01-a6a7-59ffdea93a88 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:57.160720 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-bfc4ee8d-9d9d-4b01-a6a7-59ffdea93a88 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1682 microversion: 2.1 time: 0.149601 Sep 09 12:59:57.161284 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 207/411] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:57 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:57.817717 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ab980a58-6562-4446-9c53-150b566a349e tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:57.818422 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ab980a58-6562-4446-9c53-150b566a349e tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:57.826284 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ab980a58-6562-4446-9c53-150b566a349e tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:57.826835 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ab980a58-6562-4446-9c53-150b566a349e tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:57.827284 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ab980a58-6562-4446-9c53-150b566a349e tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:57.827995 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ab980a58-6562-4446-9c53-150b566a349e tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:57.828452 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ab980a58-6562-4446-9c53-150b566a349e tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:57.828879 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ab980a58-6562-4446-9c53-150b566a349e tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:57.913639 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-586b1964-0a8a-4cd8-91ca-2a3497b1b07e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:57.915303 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-586b1964-0a8a-4cd8-91ca-2a3497b1b07e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:57.923897 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-586b1964-0a8a-4cd8-91ca-2a3497b1b07e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:57.924542 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-586b1964-0a8a-4cd8-91ca-2a3497b1b07e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:57.925223 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-586b1964-0a8a-4cd8-91ca-2a3497b1b07e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:57.926211 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-586b1964-0a8a-4cd8-91ca-2a3497b1b07e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:57.926805 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-586b1964-0a8a-4cd8-91ca-2a3497b1b07e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:57.927337 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-586b1964-0a8a-4cd8-91ca-2a3497b1b07e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:57.988794 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ab980a58-6562-4446-9c53-150b566a349e tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:57.998004 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ab980a58-6562-4446-9c53-150b566a349e tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1358 microversion: 2.1 time: 0.184558 Sep 09 12:59:57.998849 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 205/412] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:57 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:58.102985 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-586b1964-0a8a-4cd8-91ca-2a3497b1b07e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:58.102985 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-586b1964-0a8a-4cd8-91ca-2a3497b1b07e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1370 microversion: 2.1 time: 0.176651 Sep 09 12:59:58.102985 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 208/413] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:57 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:58.185980 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-527f1f04-811e-4d7b-93f5-3fb514b9a605 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:58.186671 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-527f1f04-811e-4d7b-93f5-3fb514b9a605 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:58.192768 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-527f1f04-811e-4d7b-93f5-3fb514b9a605 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:58.193255 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-527f1f04-811e-4d7b-93f5-3fb514b9a605 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:58.193718 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-527f1f04-811e-4d7b-93f5-3fb514b9a605 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:58.194412 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-527f1f04-811e-4d7b-93f5-3fb514b9a605 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:58.194896 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-527f1f04-811e-4d7b-93f5-3fb514b9a605 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:58.195318 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-527f1f04-811e-4d7b-93f5-3fb514b9a605 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:58.337060 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-527f1f04-811e-4d7b-93f5-3fb514b9a605 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:58.348185 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-527f1f04-811e-4d7b-93f5-3fb514b9a605 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1682 microversion: 2.1 time: 0.167272 Sep 09 12:59:58.348888 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 206/414] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:58 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:59.021381 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-4d145a35-f0f2-4e28-896f-f4eb8b997f64 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:59.022101 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-4d145a35-f0f2-4e28-896f-f4eb8b997f64 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:59.024160 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=2 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:59.024838 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=22 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:59.030591 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d145a35-f0f2-4e28-896f-f4eb8b997f64 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:59.036367 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d145a35-f0f2-4e28-896f-f4eb8b997f64 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:59.036367 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d145a35-f0f2-4e28-896f-f4eb8b997f64 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:59.036367 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d145a35-f0f2-4e28-896f-f4eb8b997f64 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:59.036367 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d145a35-f0f2-4e28-896f-f4eb8b997f64 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:59.036766 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d145a35-f0f2-4e28-896f-f4eb8b997f64 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:59.124027 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-eb4fae59-cfc6-48f3-b9af-b3e019b831a3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:59.124743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-eb4fae59-cfc6-48f3-b9af-b3e019b831a3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:59.128104 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=2 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:59:59.132849 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-eb4fae59-cfc6-48f3-b9af-b3e019b831a3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:59.133411 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-eb4fae59-cfc6-48f3-b9af-b3e019b831a3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:59.133859 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-eb4fae59-cfc6-48f3-b9af-b3e019b831a3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:59.134580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-eb4fae59-cfc6-48f3-b9af-b3e019b831a3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:59.135049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-eb4fae59-cfc6-48f3-b9af-b3e019b831a3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:59.136097 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-eb4fae59-cfc6-48f3-b9af-b3e019b831a3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:59.269320 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-eb4fae59-cfc6-48f3-b9af-b3e019b831a3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:59.277236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-eb4fae59-cfc6-48f3-b9af-b3e019b831a3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1370 microversion: 2.1 time: 0.158546 Sep 09 12:59:59.278131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 207/415] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:59 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:59:59.355799 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-4d145a35-f0f2-4e28-896f-f4eb8b997f64 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:59.364915 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-4d145a35-f0f2-4e28-896f-f4eb8b997f64 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1358 microversion: 2.1 time: 0.347370 Sep 09 12:59:59.365484 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 209/416] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:59 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1358 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:59:59.377867 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-4e2dca53-ad27-478b-9ab6-0a5af660a6b3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:59:59.378793 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-4e2dca53-ad27-478b-9ab6-0a5af660a6b3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:59:59.389457 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4e2dca53-ad27-478b-9ab6-0a5af660a6b3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:59.389688 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-01594e08-b204-42cf-81a1-439901e2ffcc req-722b7b7e-83f2-46b1-a70a-7fa343f960af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54af832e-58c7-4e8c-9faf-318c9b33d2d7", "tag": "a964a7f9-bcef-4299-b1fc-2858bd8b14f1"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:59:59.390313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4e2dca53-ad27-478b-9ab6-0a5af660a6b3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:59.390847 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4e2dca53-ad27-478b-9ab6-0a5af660a6b3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:59.391834 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4e2dca53-ad27-478b-9ab6-0a5af660a6b3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:59.392372 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4e2dca53-ad27-478b-9ab6-0a5af660a6b3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:59.392871 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4e2dca53-ad27-478b-9ab6-0a5af660a6b3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:59.402393 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-01594e08-b204-42cf-81a1-439901e2ffcc req-722b7b7e-83f2-46b1-a70a-7fa343f960af service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:59:59.403174 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-01594e08-b204-42cf-81a1-439901e2ffcc req-722b7b7e-83f2-46b1-a70a-7fa343f960af service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:59:59.404123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-01594e08-b204-42cf-81a1-439901e2ffcc req-722b7b7e-83f2-46b1-a70a-7fa343f960af service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:59:59.417740 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-01594e08-b204-42cf-81a1-439901e2ffcc req-722b7b7e-83f2-46b1-a70a-7fa343f960af service nova] Creating event network-changed:a964a7f9-bcef-4299-b1fc-2858bd8b14f1 for instance 54af832e-58c7-4e8c-9faf-318c9b33d2d7 on hv-cinder-81322 Sep 09 12:59:59.425904 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-01594e08-b204-42cf-81a1-439901e2ffcc req-722b7b7e-83f2-46b1-a70a-7fa343f960af service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040997 Sep 09 12:59:59.427187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 210/417] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 12:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:59:59.545201 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-4e2dca53-ad27-478b-9ab6-0a5af660a6b3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:59:59.553432 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-4e2dca53-ad27-478b-9ab6-0a5af660a6b3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1682 microversion: 2.1 time: 0.179614 Sep 09 12:59:59.554116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 208/418] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 12:59:59 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:00.300477 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-62c06e19-58c4-4ff7-aa5e-43cfb7f7aa03 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:00.301176 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-62c06e19-58c4-4ff7-aa5e-43cfb7f7aa03 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:00.307430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-62c06e19-58c4-4ff7-aa5e-43cfb7f7aa03 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:00.308127 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-62c06e19-58c4-4ff7-aa5e-43cfb7f7aa03 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:00.308758 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-62c06e19-58c4-4ff7-aa5e-43cfb7f7aa03 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:00.309630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-62c06e19-58c4-4ff7-aa5e-43cfb7f7aa03 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:00.310416 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-62c06e19-58c4-4ff7-aa5e-43cfb7f7aa03 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:00.311013 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-62c06e19-58c4-4ff7-aa5e-43cfb7f7aa03 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:00.391555 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-6ce1d7ed-648b-43a4-8e44-0d33f06a60a4 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:00.392285 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-6ce1d7ed-648b-43a4-8e44-0d33f06a60a4 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:00.406700 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6ce1d7ed-648b-43a4-8e44-0d33f06a60a4 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:00.407701 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6ce1d7ed-648b-43a4-8e44-0d33f06a60a4 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:00.408353 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6ce1d7ed-648b-43a4-8e44-0d33f06a60a4 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:00.409241 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6ce1d7ed-648b-43a4-8e44-0d33f06a60a4 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:00.409873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6ce1d7ed-648b-43a4-8e44-0d33f06a60a4 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:00.414727 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6ce1d7ed-648b-43a4-8e44-0d33f06a60a4 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:00.539555 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-62c06e19-58c4-4ff7-aa5e-43cfb7f7aa03 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:00.548459 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-62c06e19-58c4-4ff7-aa5e-43cfb7f7aa03 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1370 microversion: 2.1 time: 0.252083 Sep 09 13:00:00.563353 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 211/419] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:00 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1370 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:00.567548 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-6ce1d7ed-648b-43a4-8e44-0d33f06a60a4 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:00.576555 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-6ce1d7ed-648b-43a4-8e44-0d33f06a60a4 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1358 microversion: 2.1 time: 0.188909 Sep 09 13:00:00.577133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 209/420] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:00 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:00.583590 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-b0c3d56b-9cc2-4de7-a741-a088b87a8e2b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:00.584424 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-b0c3d56b-9cc2-4de7-a741-a088b87a8e2b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:00.591935 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b0c3d56b-9cc2-4de7-a741-a088b87a8e2b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:00.593038 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b0c3d56b-9cc2-4de7-a741-a088b87a8e2b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:00.593485 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b0c3d56b-9cc2-4de7-a741-a088b87a8e2b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:00.594198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b0c3d56b-9cc2-4de7-a741-a088b87a8e2b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:00.594702 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b0c3d56b-9cc2-4de7-a741-a088b87a8e2b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:00.595133 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b0c3d56b-9cc2-4de7-a741-a088b87a8e2b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:00.630651 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b0c3d56b-9cc2-4de7-a741-a088b87a8e2b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:00.631132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b0c3d56b-9cc2-4de7-a741-a088b87a8e2b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:00.631568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b0c3d56b-9cc2-4de7-a741-a088b87a8e2b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:00.632013 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.objects.instance [None req-b0c3d56b-9cc2-4de7-a741-a088b87a8e2b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lazy-loading 'fault' on Instance uuid 7f59545d-0b40-4f82-94e2-789c728a6bed {{(pid=127772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:00:00.678290 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-b0c3d56b-9cc2-4de7-a741-a088b87a8e2b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:00.687091 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-b0c3d56b-9cc2-4de7-a741-a088b87a8e2b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1331 microversion: 2.1 time: 0.107568 Sep 09 13:00:00.687741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 212/421] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:00 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:00:01.450751 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-f9c95784-83c1-4909-aa7d-4a5a195bccab req-b7dbf944-6163-4f20-951f-f4514c7a64cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f59545d-0b40-4f82-94e2-789c728a6bed", "name": "network-vif-deleted", "tag": "7dc91708-0aac-4dd5-b9ff-cd3faa6becbe"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:00:01.460949 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-f9c95784-83c1-4909-aa7d-4a5a195bccab req-b7dbf944-6163-4f20-951f-f4514c7a64cc service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:01.464346 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-f9c95784-83c1-4909-aa7d-4a5a195bccab req-b7dbf944-6163-4f20-951f-f4514c7a64cc service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:01.464346 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-f9c95784-83c1-4909-aa7d-4a5a195bccab req-b7dbf944-6163-4f20-951f-f4514c7a64cc service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:01.473226 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-f9c95784-83c1-4909-aa7d-4a5a195bccab req-b7dbf944-6163-4f20-951f-f4514c7a64cc service nova] Creating event network-vif-deleted:7dc91708-0aac-4dd5-b9ff-cd3faa6becbe for instance 7f59545d-0b40-4f82-94e2-789c728a6bed on hv-cinder-81322 Sep 09 13:00:01.478036 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-f9c95784-83c1-4909-aa7d-4a5a195bccab req-b7dbf944-6163-4f20-951f-f4514c7a64cc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031602 Sep 09 13:00:01.478627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 210/422] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:00:01.572523 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-858972f7-4c06-4f7d-b8e3-e3c3008a1a8b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:01.573134 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-858972f7-4c06-4f7d-b8e3-e3c3008a1a8b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:01.575120 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:00:01.580900 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-858972f7-4c06-4f7d-b8e3-e3c3008a1a8b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:01.581389 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-858972f7-4c06-4f7d-b8e3-e3c3008a1a8b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:01.581854 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-858972f7-4c06-4f7d-b8e3-e3c3008a1a8b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:01.584631 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-858972f7-4c06-4f7d-b8e3-e3c3008a1a8b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:01.584631 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-858972f7-4c06-4f7d-b8e3-e3c3008a1a8b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:01.584631 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-858972f7-4c06-4f7d-b8e3-e3c3008a1a8b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:01.600763 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-dd726f59-6a28-4c59-af74-d5515ddeafa8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:01.601694 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-dd726f59-6a28-4c59-af74-d5515ddeafa8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:01.608865 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dd726f59-6a28-4c59-af74-d5515ddeafa8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:01.617661 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dd726f59-6a28-4c59-af74-d5515ddeafa8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:01.617661 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dd726f59-6a28-4c59-af74-d5515ddeafa8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:01.617661 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dd726f59-6a28-4c59-af74-d5515ddeafa8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:01.617661 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dd726f59-6a28-4c59-af74-d5515ddeafa8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:01.618723 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dd726f59-6a28-4c59-af74-d5515ddeafa8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:01.725542 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-858972f7-4c06-4f7d-b8e3-e3c3008a1a8b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:01.733710 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-858972f7-4c06-4f7d-b8e3-e3c3008a1a8b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1370 microversion: 2.1 time: 0.165095 Sep 09 13:00:01.734280 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 213/423] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:01 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:01.749584 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-343f2311-471b-41a2-942f-8b3d5eef96a1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:01.749584 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-343f2311-471b-41a2-942f-8b3d5eef96a1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:01.749584 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-343f2311-471b-41a2-942f-8b3d5eef96a1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:01.749584 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-343f2311-471b-41a2-942f-8b3d5eef96a1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:01.750133 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-343f2311-471b-41a2-942f-8b3d5eef96a1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:01.750133 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-343f2311-471b-41a2-942f-8b3d5eef96a1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:01.750133 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-343f2311-471b-41a2-942f-8b3d5eef96a1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:01.750133 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-343f2311-471b-41a2-942f-8b3d5eef96a1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:01.770061 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-dd726f59-6a28-4c59-af74-d5515ddeafa8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:01.777824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-dd726f59-6a28-4c59-af74-d5515ddeafa8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1358 microversion: 2.1 time: 0.181322 Sep 09 13:00:01.778513 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 211/424] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:01 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:00:01.780372 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-343f2311-471b-41a2-942f-8b3d5eef96a1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:01.780852 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-343f2311-471b-41a2-942f-8b3d5eef96a1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:01.781314 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-343f2311-471b-41a2-942f-8b3d5eef96a1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:01.781763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.objects.instance [None req-343f2311-471b-41a2-942f-8b3d5eef96a1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lazy-loading 'fault' on Instance uuid 7f59545d-0b40-4f82-94e2-789c728a6bed {{(pid=127772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:00:01.821309 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-343f2311-471b-41a2-942f-8b3d5eef96a1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:01.829933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-343f2311-471b-41a2-942f-8b3d5eef96a1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 200 len: 1331 microversion: 2.1 time: 0.094605 Sep 09 13:00:01.830505 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 214/425] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:01 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:02.242370 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-14a456d3-9aee-4b93-9333-aa26907e70eb req-758e90b5-a220-4bed-a6ec-06296036100e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c", "name": "network-vif-plugged", "status": "completed", "tag": "0f732f85-125a-41ad-8d5f-adfe587313de"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:00:02.255151 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-14a456d3-9aee-4b93-9333-aa26907e70eb req-758e90b5-a220-4bed-a6ec-06296036100e service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:02.255631 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-14a456d3-9aee-4b93-9333-aa26907e70eb req-758e90b5-a220-4bed-a6ec-06296036100e service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:02.256067 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-14a456d3-9aee-4b93-9333-aa26907e70eb req-758e90b5-a220-4bed-a6ec-06296036100e service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:02.267141 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-14a456d3-9aee-4b93-9333-aa26907e70eb req-758e90b5-a220-4bed-a6ec-06296036100e service nova] Creating event network-vif-plugged:0f732f85-125a-41ad-8d5f-adfe587313de for instance 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c on hv-cinder-81322 Sep 09 13:00:02.272066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-14a456d3-9aee-4b93-9333-aa26907e70eb req-758e90b5-a220-4bed-a6ec-06296036100e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033747 Sep 09 13:00:02.272813 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 212/426] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:00:02.756873 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7023f58b-2708-4bb7-a770-dfe399048892 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:02.757492 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7023f58b-2708-4bb7-a770-dfe399048892 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:02.763476 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7023f58b-2708-4bb7-a770-dfe399048892 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:02.764479 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7023f58b-2708-4bb7-a770-dfe399048892 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:02.764923 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7023f58b-2708-4bb7-a770-dfe399048892 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:02.765611 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7023f58b-2708-4bb7-a770-dfe399048892 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:02.766069 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7023f58b-2708-4bb7-a770-dfe399048892 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:02.766511 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7023f58b-2708-4bb7-a770-dfe399048892 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:02.802600 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-9f885357-e063-4028-8d56-5690273a62ee tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:02.803307 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-9f885357-e063-4028-8d56-5690273a62ee tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:02.809861 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9f885357-e063-4028-8d56-5690273a62ee tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:02.810361 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9f885357-e063-4028-8d56-5690273a62ee tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:02.810915 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9f885357-e063-4028-8d56-5690273a62ee tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:02.811541 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9f885357-e063-4028-8d56-5690273a62ee tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:02.812000 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9f885357-e063-4028-8d56-5690273a62ee tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:02.812431 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9f885357-e063-4028-8d56-5690273a62ee tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:02.923313 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7023f58b-2708-4bb7-a770-dfe399048892 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:02.931094 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7023f58b-2708-4bb7-a770-dfe399048892 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1370 microversion: 2.1 time: 0.178046 Sep 09 13:00:02.931661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 215/427] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:02 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:02.936848 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a055193a-e941-4168-82b1-0b0d67cd541a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:02.937871 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a055193a-e941-4168-82b1-0b0d67cd541a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:02.943109 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a055193a-e941-4168-82b1-0b0d67cd541a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:02.943594 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a055193a-e941-4168-82b1-0b0d67cd541a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:02.944017 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a055193a-e941-4168-82b1-0b0d67cd541a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:02.944913 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a055193a-e941-4168-82b1-0b0d67cd541a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:02.945365 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a055193a-e941-4168-82b1-0b0d67cd541a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:02.945787 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a055193a-e941-4168-82b1-0b0d67cd541a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:02.959046 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-9f885357-e063-4028-8d56-5690273a62ee tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:02.959470 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-a055193a-e941-4168-82b1-0b0d67cd541a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] HTTP exception thrown: Instance 7f59545d-0b40-4f82-94e2-789c728a6bed could not be found. Sep 09 13:00:02.961125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a055193a-e941-4168-82b1-0b0d67cd541a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Request method failure captured: Sep 09 13:00:02.961125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed HTTP/1.1 Sep 09 13:00:02.961125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 13:00:02.961125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 13:00:02.961125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 13:00:02.961125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 13:00:02.961125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 13:00:02.961125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 13:00:02.961125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 13:00:02.961125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 13:00:02.961125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGzgEaKb6PZCqo9yxUSEJiFD1xb1LGODlWVgID9cA22eqBLNomTmu2q0yMgjccpW69nnUAUWKXMpFaG8X-sF87AhuIdLNOF9PvF4tjoZWf7SNwd1H5TWSvp_IUIt9lOp_NKX-JRPFLgnDrNAvr9jG5GRaXTb0sVN8rNo6hRRXay_HW10 Sep 09 13:00:02.961125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 13:00:02.961125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 13:00:02.961125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 13:00:02.961125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 13:00:02.961125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 13:00:02.961125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 13:00:02.961125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:00:02.961125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:00:02.961125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 13:00:02.961125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 13:00:02.962568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ceed6a1f0f4542cbafa4b2a46b16d5fb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}] Sep 09 13:00:02.962568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:00:02.962568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:00:02.962568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:00:02.962568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:00:02.962568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 13:00:02.962568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 13:00:02.962568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: 63a2902f465f4fd1aed80060c2669259 Sep 09 13:00:02.962568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:00:02.962568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: > Sep 09 13:00:02.962568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Instance 7f59545d-0b40-4f82-94e2-789c728a6bed could not be found. Sep 09 13:00:02.962568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'id': '7f59545d-0b40-4f82-94e2-789c728a6bed'} Sep 09 13:00:02.966956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:00:02.966956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:00:02.966956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:00:02.966956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:00:02.966956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:00:02.966956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:00:02.966956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:00:02.966956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:00:02.966956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:00:02.966956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:00:02.966956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f59545d-0b40-4f82-94e2-789c728a6bed could not be found. Sep 09 13:00:02.966956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:00:02.966956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:00:02.966956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:00:02.966956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:00:02.966956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:00:02.966956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:00:02.966956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:00:02.966956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:00:02.966956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:00:02.968294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:00:02.968294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:00:02.968294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:00:02.968294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:00:02.968294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:00:02.968294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:00:02.968294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:00:02.968294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f59545d-0b40-4f82-94e2-789c728a6bed could not be found. Sep 09 13:00:02.968294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:00:02.968294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:00:02.968294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:00:02.968294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:00:02.968294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:00:02.968294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:00:02.968294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:00:02.968294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:00:02.968294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f59545d-0b40-4f82-94e2-789c728a6bed could not be found. Sep 09 13:00:02.968294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:00:02.969326 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a055193a-e941-4168-82b1-0b0d67cd541a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Returning 404 to user: Instance 7f59545d-0b40-4f82-94e2-789c728a6bed could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:00:02.969326 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a055193a-e941-4168-82b1-0b0d67cd541a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 404 len: 111 microversion: 2.1 time: 0.029920 Sep 09 13:00:02.969326 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 216/428] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:02 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:00:02.969527 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-9f885357-e063-4028-8d56-5690273a62ee tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1358 microversion: 2.1 time: 0.168894 Sep 09 13:00:02.969527 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 213/429] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:02 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:00:02.971408 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7b6b5ddd-b5ea-4457-a42a-12c81c2b9bfa tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '.version_select at 0x7f318327cf70>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:03.041327 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7b6b5ddd-b5ea-4457-a42a-12c81c2b9bfa tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1609297797" status: 202 len: 0 microversion: 2.1 time: 0.073706 Sep 09 13:00:03.041916 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 217/430] 10.222.0.46 () {58 vars in 1221 bytes} [Fri Sep 9 13:00:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1609297797 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 13:00:03.790346 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d77e9ea7-36a9-4faf-8b14-28dc7f4e7248 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Action: 'create', calling method: .version_select at 0x7f3183228670>, body: {"keypair": {"name": "tempest-keypair-1964468938", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLYVWipoYAURqDXryJY8O0re5M5upv9TWJcSm7jG5vkR2bpeWhKA7OOpNQQHZQQ35jUQ7HJ9dSStIa5dGUoVP5HKN5to7gZT7I3jQfHYCkLcTUudCuVroBgtzS5eW1vqA=="}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:00:03.806066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-d77e9ea7-36a9-4faf-8b14-28dc7f4e7248 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Getting quotas for project ceed6a1f0f4542cbafa4b2a46b16d5fb. Resources: {'key_pairs'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:00:03.809999 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-d77e9ea7-36a9-4faf-8b14-28dc7f4e7248 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Getting quotas for user 63a2902f465f4fd1aed80060c2669259 and project ceed6a1f0f4542cbafa4b2a46b16d5fb. Resources: {'key_pairs'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:00:03.924633 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d77e9ea7-36a9-4faf-8b14-28dc7f4e7248 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.138111 Sep 09 13:00:03.926194 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 214/431] 10.222.0.46 () {60 vars in 1159 bytes} [Fri Sep 9 13:00:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:00:03.954511 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-96844a29-3068-4fc0-8136-3e01d3fc834a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:03.955244 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-96844a29-3068-4fc0-8136-3e01d3fc834a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:03.962154 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-96844a29-3068-4fc0-8136-3e01d3fc834a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:03.962701 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-96844a29-3068-4fc0-8136-3e01d3fc834a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:03.963147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-96844a29-3068-4fc0-8136-3e01d3fc834a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:03.963850 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-96844a29-3068-4fc0-8136-3e01d3fc834a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:03.964318 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-96844a29-3068-4fc0-8136-3e01d3fc834a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:03.964751 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-96844a29-3068-4fc0-8136-3e01d3fc834a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:03.990987 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d0e5c733-010d-4591-9256-97cce7a1ad60 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:03.991607 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-d0e5c733-010d-4591-9256-97cce7a1ad60 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:03.997622 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d0e5c733-010d-4591-9256-97cce7a1ad60 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:03.998719 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d0e5c733-010d-4591-9256-97cce7a1ad60 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:03.999324 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d0e5c733-010d-4591-9256-97cce7a1ad60 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:04.000029 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d0e5c733-010d-4591-9256-97cce7a1ad60 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:04.000512 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d0e5c733-010d-4591-9256-97cce7a1ad60 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:04.000947 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d0e5c733-010d-4591-9256-97cce7a1ad60 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:04.146364 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-d0e5c733-010d-4591-9256-97cce7a1ad60 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:04.154795 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d0e5c733-010d-4591-9256-97cce7a1ad60 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1358 microversion: 2.1 time: 0.167097 Sep 09 13:00:04.159005 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 215/432] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:03 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:00:04.167033 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-96844a29-3068-4fc0-8136-3e01d3fc834a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:04.176275 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-96844a29-3068-4fc0-8136-3e01d3fc834a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1370 microversion: 2.1 time: 0.226712 Sep 09 13:00:04.178693 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 218/433] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:03 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1370 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:04.287836 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-368a8a99-3fe6-45ad-be69-45a07ad2ac61 req-a3f7374f-a842-4b0d-b633-7da6b4b685b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54af832e-58c7-4e8c-9faf-318c9b33d2d7", "name": "network-vif-plugged", "status": "completed", "tag": "a964a7f9-bcef-4299-b1fc-2858bd8b14f1"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:00:04.300048 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-368a8a99-3fe6-45ad-be69-45a07ad2ac61 req-a3f7374f-a842-4b0d-b633-7da6b4b685b0 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:04.300602 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-368a8a99-3fe6-45ad-be69-45a07ad2ac61 req-a3f7374f-a842-4b0d-b633-7da6b4b685b0 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:04.301176 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-368a8a99-3fe6-45ad-be69-45a07ad2ac61 req-a3f7374f-a842-4b0d-b633-7da6b4b685b0 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:04.313654 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-368a8a99-3fe6-45ad-be69-45a07ad2ac61 req-a3f7374f-a842-4b0d-b633-7da6b4b685b0 service nova] Creating event network-vif-plugged:a964a7f9-bcef-4299-b1fc-2858bd8b14f1 for instance 54af832e-58c7-4e8c-9faf-318c9b33d2d7 on hv-cinder-81322 Sep 09 13:00:04.319063 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-368a8a99-3fe6-45ad-be69-45a07ad2ac61 req-a3f7374f-a842-4b0d-b633-7da6b4b685b0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035631 Sep 09 13:00:04.320090 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 216/434] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:00:05.180638 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-34382d57-63f9-47a0-a804-af9e6194edfc tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:05.181249 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-34382d57-63f9-47a0-a804-af9e6194edfc tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:05.190779 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-34382d57-63f9-47a0-a804-af9e6194edfc tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:05.191274 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-34382d57-63f9-47a0-a804-af9e6194edfc tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:05.191712 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-34382d57-63f9-47a0-a804-af9e6194edfc tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:05.192421 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-34382d57-63f9-47a0-a804-af9e6194edfc tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:05.192881 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-34382d57-63f9-47a0-a804-af9e6194edfc tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:05.193309 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-34382d57-63f9-47a0-a804-af9e6194edfc tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:05.199342 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0a7d4bd5-1916-4d96-988c-1544933c6659 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:05.200262 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-0a7d4bd5-1916-4d96-988c-1544933c6659 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:05.208234 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0a7d4bd5-1916-4d96-988c-1544933c6659 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:05.208842 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0a7d4bd5-1916-4d96-988c-1544933c6659 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:05.209633 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0a7d4bd5-1916-4d96-988c-1544933c6659 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:05.210439 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0a7d4bd5-1916-4d96-988c-1544933c6659 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:05.211005 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0a7d4bd5-1916-4d96-988c-1544933c6659 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:05.211530 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0a7d4bd5-1916-4d96-988c-1544933c6659 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:05.333466 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-34382d57-63f9-47a0-a804-af9e6194edfc tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:05.349051 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-34382d57-63f9-47a0-a804-af9e6194edfc tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1548 microversion: 2.1 time: 0.173281 Sep 09 13:00:05.349938 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 219/435] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:05 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1548 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:05.375304 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a03a3a95-7672-4191-99da-899b4cf551a0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:05.375854 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a03a3a95-7672-4191-99da-899b4cf551a0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:05.382357 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a03a3a95-7672-4191-99da-899b4cf551a0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:05.382885 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a03a3a95-7672-4191-99da-899b4cf551a0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:05.383322 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a03a3a95-7672-4191-99da-899b4cf551a0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:05.384034 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a03a3a95-7672-4191-99da-899b4cf551a0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:05.384492 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a03a3a95-7672-4191-99da-899b4cf551a0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:05.384917 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a03a3a95-7672-4191-99da-899b4cf551a0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:05.524779 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a03a3a95-7672-4191-99da-899b4cf551a0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:05.533140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a03a3a95-7672-4191-99da-899b4cf551a0 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1548 microversion: 2.1 time: 0.162996 Sep 09 13:00:05.533717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 220/436] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:05 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:00:05.555856 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-8a761d35-c602-4abb-aa7d-c749372547c3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:05.561356 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-8a761d35-c602-4abb-aa7d-c749372547c3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:05.562293 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-8a761d35-c602-4abb-aa7d-c749372547c3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Searching by: {'deleted': False, 'project_id': 'bfb3240493c84bda8102619400759342'} {{(pid=127772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 09 13:00:05.568890 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8a761d35-c602-4abb-aa7d-c749372547c3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:05.569368 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8a761d35-c602-4abb-aa7d-c749372547c3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:05.569801 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8a761d35-c602-4abb-aa7d-c749372547c3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:05.570547 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8a761d35-c602-4abb-aa7d-c749372547c3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:05.571009 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8a761d35-c602-4abb-aa7d-c749372547c3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:05.571433 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8a761d35-c602-4abb-aa7d-c749372547c3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:05.637310 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-0a7d4bd5-1916-4d96-988c-1544933c6659 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:05.642013 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=100 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:00:05.646788 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0a7d4bd5-1916-4d96-988c-1544933c6659 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1370 microversion: 2.1 time: 0.451551 Sep 09 13:00:05.647486 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 217/437] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:05 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1370 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:00:05.666748 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.multi_cell_list [None req-8a761d35-c602-4abb-aa7d-c749372547c3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127772) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 09 13:00:05.748675 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:00:05.765797 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-8a761d35-c602-4abb-aa7d-c749372547c3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.213702 Sep 09 13:00:05.766388 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 221/438] 10.222.0.46 () {58 vars in 1125 bytes} [Fri Sep 9 13:00:05 2022] GET /compute/v2.1/servers => generated 343 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:00:05.778031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-b62d2dfd-3d73-4709-8506-e532cdf96c96 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:05.778685 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-b62d2dfd-3d73-4709-8506-e532cdf96c96 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:05.785453 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b62d2dfd-3d73-4709-8506-e532cdf96c96 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:05.785937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b62d2dfd-3d73-4709-8506-e532cdf96c96 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:05.786376 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b62d2dfd-3d73-4709-8506-e532cdf96c96 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:05.787092 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b62d2dfd-3d73-4709-8506-e532cdf96c96 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:05.787551 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b62d2dfd-3d73-4709-8506-e532cdf96c96 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:05.787977 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b62d2dfd-3d73-4709-8506-e532cdf96c96 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:06.021526 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-b62d2dfd-3d73-4709-8506-e532cdf96c96 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:06.029370 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-b62d2dfd-3d73-4709-8506-e532cdf96c96 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1548 microversion: 2.1 time: 0.255170 Sep 09 13:00:06.030163 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 218/439] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:05 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1548 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:06.665611 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-2c2f3dd0-4e62-4fa3-81f4-c576e8d24a20 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-626948446", "imageRef": "355bded2-2225-44b2-af86-f9e1861d05ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4f411e2-e42e-4ab3-86d3-b0b098a1a8fe"}], "security_groups": [{"name": "tempest-securitygroup--256255916"}], "key_name": "tempest-keypair-1964468938", "user_data": "}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:00:06.669080 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-62a58a6b-663b-4c70-91e9-622d8fbdac06 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:06.671431 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-62a58a6b-663b-4c70-91e9-622d8fbdac06 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:06.698292 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-62a58a6b-663b-4c70-91e9-622d8fbdac06 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:06.698829 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-62a58a6b-663b-4c70-91e9-622d8fbdac06 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:06.699410 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-62a58a6b-663b-4c70-91e9-622d8fbdac06 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:06.699981 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-62a58a6b-663b-4c70-91e9-622d8fbdac06 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:06.700442 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-62a58a6b-663b-4c70-91e9-622d8fbdac06 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:06.700863 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-62a58a6b-663b-4c70-91e9-622d8fbdac06 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:06.784230 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.network.neutron [None req-2c2f3dd0-4e62-4fa3-81f4-c576e8d24a20 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] validate_networks() for [('c4f411e2-e42e-4ab3-86d3-b0b098a1a8fe', None, None, None, None, None)] {{(pid=127772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:00:06.881459 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-62a58a6b-663b-4c70-91e9-622d8fbdac06 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:06.884262 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-62a58a6b-663b-4c70-91e9-622d8fbdac06 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1370 microversion: 2.1 time: 0.219092 Sep 09 13:00:06.884832 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 219/440] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:06 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1370 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:07.386952 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-2c2f3dd0-4e62-4fa3-81f4-c576e8d24a20 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Flavor limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:00:07.387367 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-2c2f3dd0-4e62-4fa3-81f4-c576e8d24a20 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Image limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:00:07.387846 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-2c2f3dd0-4e62-4fa3-81f4-c576e8d24a20 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Flavor pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:00:07.388292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-2c2f3dd0-4e62-4fa3-81f4-c576e8d24a20 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Image pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:00:07.389389 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-2c2f3dd0-4e62-4fa3-81f4-c576e8d24a20 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:00:07.403102 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2c2f3dd0-4e62-4fa3-81f4-c576e8d24a20 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:07.403619 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2c2f3dd0-4e62-4fa3-81f4-c576e8d24a20 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:07.404114 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2c2f3dd0-4e62-4fa3-81f4-c576e8d24a20 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:07.405443 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2c2f3dd0-4e62-4fa3-81f4-c576e8d24a20 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:07.405902 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2c2f3dd0-4e62-4fa3-81f4-c576e8d24a20 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:07.406330 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2c2f3dd0-4e62-4fa3-81f4-c576e8d24a20 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:07.423418 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-2c2f3dd0-4e62-4fa3-81f4-c576e8d24a20 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Getting quotas for project ceed6a1f0f4542cbafa4b2a46b16d5fb. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:00:07.427378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-2c2f3dd0-4e62-4fa3-81f4-c576e8d24a20 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Getting quotas for user 63a2902f465f4fd1aed80060c2669259 and project ceed6a1f0f4542cbafa4b2a46b16d5fb. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:00:07.438607 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-2c2f3dd0-4e62-4fa3-81f4-c576e8d24a20 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Going to run 1 instances... {{(pid=127772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:00:07.441019 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-2c2f3dd0-4e62-4fa3-81f4-c576e8d24a20 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='355bded2-2225-44b2-af86-f9e1861d05ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:00:07.546174 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-2c2f3dd0-4e62-4fa3-81f4-c576e8d24a20 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.885320 Sep 09 13:00:07.546974 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 222/441] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 13:00:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 13:00:07.558428 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-6901d460-4dd9-4363-87e9-02e14e61c2c9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:07.559067 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-6901d460-4dd9-4363-87e9-02e14e61c2c9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:07.612307 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-6901d460-4dd9-4363-87e9-02e14e61c2c9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:07.619419 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-6901d460-4dd9-4363-87e9-02e14e61c2c9 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e" status: 200 len: 1241 microversion: 2.1 time: 0.065074 Sep 09 13:00:07.620180 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 220/442] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:07 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:07.907758 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-18427118-85ac-4067-b49e-d20f3ef05781 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:07.908491 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-18427118-85ac-4067-b49e-d20f3ef05781 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:07.915250 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-18427118-85ac-4067-b49e-d20f3ef05781 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:07.915902 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-18427118-85ac-4067-b49e-d20f3ef05781 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:07.916461 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-18427118-85ac-4067-b49e-d20f3ef05781 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:07.917433 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-18427118-85ac-4067-b49e-d20f3ef05781 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:07.918231 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-18427118-85ac-4067-b49e-d20f3ef05781 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:07.918895 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-18427118-85ac-4067-b49e-d20f3ef05781 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:08.003076 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-53b865c7-017d-4719-be37-e9160971a925 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79aa33e7-6bdb-4491-bfd7-424cccb8315f"}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:00:08.005763 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-53b865c7-017d-4719-be37-e9160971a925 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:08.012628 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-53b865c7-017d-4719-be37-e9160971a925 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:08.013111 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-53b865c7-017d-4719-be37-e9160971a925 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:08.013902 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-53b865c7-017d-4719-be37-e9160971a925 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:08.014638 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-53b865c7-017d-4719-be37-e9160971a925 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:08.015091 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-53b865c7-017d-4719-be37-e9160971a925 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:08.015521 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-53b865c7-017d-4719-be37-e9160971a925 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:08.066712 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-18427118-85ac-4067-b49e-d20f3ef05781 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:08.072936 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-18427118-85ac-4067-b49e-d20f3ef05781 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1564 microversion: 2.1 time: 0.169405 Sep 09 13:00:08.073525 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 223/443] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:07 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:08.096826 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-f6f074b3-721b-49ce-95fd-c1bfc3170746 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:08.097326 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-f6f074b3-721b-49ce-95fd-c1bfc3170746 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:08.107012 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f6f074b3-721b-49ce-95fd-c1bfc3170746 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:08.107680 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f6f074b3-721b-49ce-95fd-c1bfc3170746 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:08.107961 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f6f074b3-721b-49ce-95fd-c1bfc3170746 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:08.108749 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f6f074b3-721b-49ce-95fd-c1bfc3170746 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:08.109215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f6f074b3-721b-49ce-95fd-c1bfc3170746 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:08.109640 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f6f074b3-721b-49ce-95fd-c1bfc3170746 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:08.198071 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-f6f074b3-721b-49ce-95fd-c1bfc3170746 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105017 Sep 09 13:00:08.199365 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 224/444] 10.222.0.46 () {58 vars in 1275 bytes} [Fri Sep 9 13:00:08 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:00:08.641525 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-01e4b965-0a6e-439f-8202-84b0c848acde tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:08.642131 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-01e4b965-0a6e-439f-8202-84b0c848acde tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:08.649049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-01e4b965-0a6e-439f-8202-84b0c848acde tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:08.649536 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-01e4b965-0a6e-439f-8202-84b0c848acde tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:08.649962 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-01e4b965-0a6e-439f-8202-84b0c848acde tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:08.650686 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-01e4b965-0a6e-439f-8202-84b0c848acde tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:08.651132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-01e4b965-0a6e-439f-8202-84b0c848acde tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:08.651553 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-01e4b965-0a6e-439f-8202-84b0c848acde tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:08.716386 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-01e4b965-0a6e-439f-8202-84b0c848acde tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:08.724703 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-01e4b965-0a6e-439f-8202-84b0c848acde tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e" status: 200 len: 1245 microversion: 2.1 time: 0.087081 Sep 09 13:00:08.725260 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 225/445] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:08 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:00:08.879117 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-53b865c7-017d-4719-be37-e9160971a925 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "POST /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.882134 Sep 09 13:00:08.879712 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 221/446] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 13:00:07 2022] POST /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c/os-volume_attachments => generated 194 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:00:09.237024 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-5b655444-bde7-48e0-8248-c22d1d47e21b req-9db572db-5c0f-420c-9557-f4d03a2c055e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54af832e-58c7-4e8c-9faf-318c9b33d2d7", "tag": "a964a7f9-bcef-4299-b1fc-2858bd8b14f1"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:00:09.247431 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-5b655444-bde7-48e0-8248-c22d1d47e21b req-9db572db-5c0f-420c-9557-f4d03a2c055e service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:09.248666 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-5b655444-bde7-48e0-8248-c22d1d47e21b req-9db572db-5c0f-420c-9557-f4d03a2c055e service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:09.249189 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-5b655444-bde7-48e0-8248-c22d1d47e21b req-9db572db-5c0f-420c-9557-f4d03a2c055e service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:09.261616 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-5b655444-bde7-48e0-8248-c22d1d47e21b req-9db572db-5c0f-420c-9557-f4d03a2c055e service nova] Creating event network-changed:a964a7f9-bcef-4299-b1fc-2858bd8b14f1 for instance 54af832e-58c7-4e8c-9faf-318c9b33d2d7 on hv-cinder-81322 Sep 09 13:00:09.267504 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-5b655444-bde7-48e0-8248-c22d1d47e21b req-9db572db-5c0f-420c-9557-f4d03a2c055e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034413 Sep 09 13:00:09.268100 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 226/447] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:00:09.748661 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-4ae832fe-57f2-4ddc-babb-5ec59c446cb6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:09.749563 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-4ae832fe-57f2-4ddc-babb-5ec59c446cb6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:09.756441 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4ae832fe-57f2-4ddc-babb-5ec59c446cb6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:09.759265 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4ae832fe-57f2-4ddc-babb-5ec59c446cb6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:09.759265 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4ae832fe-57f2-4ddc-babb-5ec59c446cb6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:09.759265 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4ae832fe-57f2-4ddc-babb-5ec59c446cb6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:09.759265 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4ae832fe-57f2-4ddc-babb-5ec59c446cb6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:09.759637 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4ae832fe-57f2-4ddc-babb-5ec59c446cb6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:09.828116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-4ae832fe-57f2-4ddc-babb-5ec59c446cb6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:09.839141 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-4ae832fe-57f2-4ddc-babb-5ec59c446cb6 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e" status: 200 len: 1293 microversion: 2.1 time: 0.094628 Sep 09 13:00:09.840109 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 222/448] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:09 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:10.864004 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-47815e8b-c168-40c2-b64d-cfa67f3925a5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:10.864785 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-47815e8b-c168-40c2-b64d-cfa67f3925a5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:10.871163 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-47815e8b-c168-40c2-b64d-cfa67f3925a5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:10.871648 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-47815e8b-c168-40c2-b64d-cfa67f3925a5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:10.872121 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-47815e8b-c168-40c2-b64d-cfa67f3925a5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:10.872950 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-47815e8b-c168-40c2-b64d-cfa67f3925a5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:10.873408 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-47815e8b-c168-40c2-b64d-cfa67f3925a5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:10.873863 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-47815e8b-c168-40c2-b64d-cfa67f3925a5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:11.296065 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-47815e8b-c168-40c2-b64d-cfa67f3925a5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:11.304047 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-47815e8b-c168-40c2-b64d-cfa67f3925a5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e" status: 200 len: 1366 microversion: 2.1 time: 0.444534 Sep 09 13:00:11.304628 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 227/449] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:10 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e => generated 1366 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:12.036914 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-7188fa4e-aed1-4e23-8cc5-19ed7a12b682 req-2dc88a99-8c54-432c-a1d7-403510b78ead service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfc21374-47be-4788-8ba9-e2f77ae73d6e", "tag": "f11c548b-432c-4945-bede-1e36e6933ffa"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:00:12.047050 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-7188fa4e-aed1-4e23-8cc5-19ed7a12b682 req-2dc88a99-8c54-432c-a1d7-403510b78ead service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:12.047535 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-7188fa4e-aed1-4e23-8cc5-19ed7a12b682 req-2dc88a99-8c54-432c-a1d7-403510b78ead service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:12.047970 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-7188fa4e-aed1-4e23-8cc5-19ed7a12b682 req-2dc88a99-8c54-432c-a1d7-403510b78ead service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:12.059424 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-7188fa4e-aed1-4e23-8cc5-19ed7a12b682 req-2dc88a99-8c54-432c-a1d7-403510b78ead service nova] Creating event network-changed:f11c548b-432c-4945-bede-1e36e6933ffa for instance cfc21374-47be-4788-8ba9-e2f77ae73d6e on hv-cinder-81322 Sep 09 13:00:12.064703 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-7188fa4e-aed1-4e23-8cc5-19ed7a12b682 req-2dc88a99-8c54-432c-a1d7-403510b78ead service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031997 Sep 09 13:00:12.065571 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 223/450] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:00:12.328804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-705811b1-5e32-41c2-97f5-493326c75b8c tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:12.329731 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-705811b1-5e32-41c2-97f5-493326c75b8c tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:12.335886 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-705811b1-5e32-41c2-97f5-493326c75b8c tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:12.336368 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-705811b1-5e32-41c2-97f5-493326c75b8c tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:12.336801 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-705811b1-5e32-41c2-97f5-493326c75b8c tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:12.337562 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-705811b1-5e32-41c2-97f5-493326c75b8c tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:12.338010 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-705811b1-5e32-41c2-97f5-493326c75b8c tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:12.338433 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-705811b1-5e32-41c2-97f5-493326c75b8c tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:12.558828 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-705811b1-5e32-41c2-97f5-493326c75b8c tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:12.566712 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-705811b1-5e32-41c2-97f5-493326c75b8c tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e" status: 200 len: 1366 microversion: 2.1 time: 0.242641 Sep 09 13:00:12.567288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 228/451] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:12 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:13.591595 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-899074dc-b8c0-4626-a962-e3676d252f5d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:13.592454 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-899074dc-b8c0-4626-a962-e3676d252f5d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:13.599227 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-899074dc-b8c0-4626-a962-e3676d252f5d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:13.599718 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-899074dc-b8c0-4626-a962-e3676d252f5d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:13.600163 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-899074dc-b8c0-4626-a962-e3676d252f5d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:13.600854 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-899074dc-b8c0-4626-a962-e3676d252f5d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:13.601312 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-899074dc-b8c0-4626-a962-e3676d252f5d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:13.601740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-899074dc-b8c0-4626-a962-e3676d252f5d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:13.735599 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-899074dc-b8c0-4626-a962-e3676d252f5d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:13.743365 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-899074dc-b8c0-4626-a962-e3676d252f5d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e" status: 200 len: 1366 microversion: 2.1 time: 0.156030 Sep 09 13:00:13.743930 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 224/452] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:13 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:14.765890 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-05c35d5d-5143-405d-a74a-3efa06e25989 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:14.766564 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-05c35d5d-5143-405d-a74a-3efa06e25989 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:14.772600 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-05c35d5d-5143-405d-a74a-3efa06e25989 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:14.773127 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-05c35d5d-5143-405d-a74a-3efa06e25989 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:14.773508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-05c35d5d-5143-405d-a74a-3efa06e25989 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:14.774196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-05c35d5d-5143-405d-a74a-3efa06e25989 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:14.774676 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-05c35d5d-5143-405d-a74a-3efa06e25989 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:14.775096 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-05c35d5d-5143-405d-a74a-3efa06e25989 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:14.901132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-05c35d5d-5143-405d-a74a-3efa06e25989 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:14.908845 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-05c35d5d-5143-405d-a74a-3efa06e25989 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e" status: 200 len: 1366 microversion: 2.1 time: 0.147516 Sep 09 13:00:14.909499 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 229/453] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:14 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:15.932008 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-883ac4e4-761b-48a9-b305-685c27601f69 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:15.932624 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-883ac4e4-761b-48a9-b305-685c27601f69 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:15.940120 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-883ac4e4-761b-48a9-b305-685c27601f69 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:15.940610 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-883ac4e4-761b-48a9-b305-685c27601f69 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:15.941052 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-883ac4e4-761b-48a9-b305-685c27601f69 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:15.941752 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-883ac4e4-761b-48a9-b305-685c27601f69 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:15.942264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-883ac4e4-761b-48a9-b305-685c27601f69 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:15.942684 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-883ac4e4-761b-48a9-b305-685c27601f69 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:16.080316 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-883ac4e4-761b-48a9-b305-685c27601f69 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:16.088293 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-883ac4e4-761b-48a9-b305-685c27601f69 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e" status: 200 len: 1366 microversion: 2.1 time: 0.160282 Sep 09 13:00:16.088861 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 225/454] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:15 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:16.214972 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-3a8a835b-e92f-4ee2-b568-cbc0ef81db07 req-ac878652-216d-41a0-9336-216e32a8a8f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfc21374-47be-4788-8ba9-e2f77ae73d6e", "name": "network-vif-plugged", "status": "completed", "tag": "f11c548b-432c-4945-bede-1e36e6933ffa"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:00:16.224549 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-3a8a835b-e92f-4ee2-b568-cbc0ef81db07 req-ac878652-216d-41a0-9336-216e32a8a8f7 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:16.225021 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-3a8a835b-e92f-4ee2-b568-cbc0ef81db07 req-ac878652-216d-41a0-9336-216e32a8a8f7 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:16.225490 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-3a8a835b-e92f-4ee2-b568-cbc0ef81db07 req-ac878652-216d-41a0-9336-216e32a8a8f7 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:16.236451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-3a8a835b-e92f-4ee2-b568-cbc0ef81db07 req-ac878652-216d-41a0-9336-216e32a8a8f7 service nova] Creating event network-vif-plugged:f11c548b-432c-4945-bede-1e36e6933ffa for instance cfc21374-47be-4788-8ba9-e2f77ae73d6e on hv-cinder-81322 Sep 09 13:00:16.241221 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-3a8a835b-e92f-4ee2-b568-cbc0ef81db07 req-ac878652-216d-41a0-9336-216e32a8a8f7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029872 Sep 09 13:00:16.241811 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 230/455] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:00:16.550389 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-dc39f083-c9db-4c1e-b845-d0ca468bf1bc tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:16.551045 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-dc39f083-c9db-4c1e-b845-d0ca468bf1bc tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:16.557241 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dc39f083-c9db-4c1e-b845-d0ca468bf1bc tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:16.557731 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dc39f083-c9db-4c1e-b845-d0ca468bf1bc tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:16.558173 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dc39f083-c9db-4c1e-b845-d0ca468bf1bc tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:16.558908 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dc39f083-c9db-4c1e-b845-d0ca468bf1bc tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:16.559395 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dc39f083-c9db-4c1e-b845-d0ca468bf1bc tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:16.559823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dc39f083-c9db-4c1e-b845-d0ca468bf1bc tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:16.693335 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-dc39f083-c9db-4c1e-b845-d0ca468bf1bc tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:16.701684 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-dc39f083-c9db-4c1e-b845-d0ca468bf1bc tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1594 microversion: 2.1 time: 0.155295 Sep 09 13:00:16.702189 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 226/456] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:16 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1594 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:17.112805 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-dbe265bf-a72f-4f06-b263-f2e84214e711 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:17.113509 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-dbe265bf-a72f-4f06-b263-f2e84214e711 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:17.119964 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dbe265bf-a72f-4f06-b263-f2e84214e711 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:17.120463 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dbe265bf-a72f-4f06-b263-f2e84214e711 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:17.120903 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dbe265bf-a72f-4f06-b263-f2e84214e711 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:17.121611 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dbe265bf-a72f-4f06-b263-f2e84214e711 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:17.122073 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dbe265bf-a72f-4f06-b263-f2e84214e711 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:17.122525 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dbe265bf-a72f-4f06-b263-f2e84214e711 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:17.322083 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-dbe265bf-a72f-4f06-b263-f2e84214e711 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:17.330047 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-dbe265bf-a72f-4f06-b263-f2e84214e711 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e" status: 200 len: 1366 microversion: 2.1 time: 0.221814 Sep 09 13:00:17.330650 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 231/457] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:17 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:18.352199 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-26c21aa4-c786-4a6e-8534-bc97fdf97183 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:18.352810 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-26c21aa4-c786-4a6e-8534-bc97fdf97183 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:18.356506 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=6 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:00:18.360743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-26c21aa4-c786-4a6e-8534-bc97fdf97183 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:18.361220 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-26c21aa4-c786-4a6e-8534-bc97fdf97183 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:18.361657 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-26c21aa4-c786-4a6e-8534-bc97fdf97183 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:18.362346 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-26c21aa4-c786-4a6e-8534-bc97fdf97183 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:18.362822 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-26c21aa4-c786-4a6e-8534-bc97fdf97183 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:18.363243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-26c21aa4-c786-4a6e-8534-bc97fdf97183 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:18.497636 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-26c21aa4-c786-4a6e-8534-bc97fdf97183 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:18.506062 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-26c21aa4-c786-4a6e-8534-bc97fdf97183 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e" status: 200 len: 1557 microversion: 2.1 time: 0.157865 Sep 09 13:00:18.506862 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 227/458] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:18 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:18.529295 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a9948e51-2b18-42fe-bc2e-1e2a832d8141 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:18.529859 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a9948e51-2b18-42fe-bc2e-1e2a832d8141 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:18.532273 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=4 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:00:18.538603 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=6 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:00:18.539347 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a9948e51-2b18-42fe-bc2e-1e2a832d8141 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:18.540003 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a9948e51-2b18-42fe-bc2e-1e2a832d8141 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:18.540576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a9948e51-2b18-42fe-bc2e-1e2a832d8141 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:18.541917 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a9948e51-2b18-42fe-bc2e-1e2a832d8141 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:18.541917 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a9948e51-2b18-42fe-bc2e-1e2a832d8141 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:18.542360 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a9948e51-2b18-42fe-bc2e-1e2a832d8141 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:18.635158 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a9948e51-2b18-42fe-bc2e-1e2a832d8141 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109692 Sep 09 13:00:18.635826 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 232/459] 10.222.0.46 () {58 vars in 1275 bytes} [Fri Sep 9 13:00:18 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:00:18.859904 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-168689d6-3456-4c9b-b155-d0d6b2f1317c req-25cfdb02-960b-44cd-b8e6-3e030e53dc48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c", "tag": "0f732f85-125a-41ad-8d5f-adfe587313de"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:00:18.865314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:00:18.871122 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-168689d6-3456-4c9b-b155-d0d6b2f1317c req-25cfdb02-960b-44cd-b8e6-3e030e53dc48 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:18.871612 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-168689d6-3456-4c9b-b155-d0d6b2f1317c req-25cfdb02-960b-44cd-b8e6-3e030e53dc48 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:18.872049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-168689d6-3456-4c9b-b155-d0d6b2f1317c req-25cfdb02-960b-44cd-b8e6-3e030e53dc48 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:18.883791 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-168689d6-3456-4c9b-b155-d0d6b2f1317c req-25cfdb02-960b-44cd-b8e6-3e030e53dc48 service nova] Creating event network-changed:0f732f85-125a-41ad-8d5f-adfe587313de for instance 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c on hv-cinder-81322 Sep 09 13:00:18.888887 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-168689d6-3456-4c9b-b155-d0d6b2f1317c req-25cfdb02-960b-44cd-b8e6-3e030e53dc48 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032799 Sep 09 13:00:18.890321 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 228/460] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:00:19.897197 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-9dd9f35f-2da2-49f9-aab9-7be0ce871d39 req-0b2792d7-ee56-4ab0-81df-cf387e0df58d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfc21374-47be-4788-8ba9-e2f77ae73d6e", "tag": "f11c548b-432c-4945-bede-1e36e6933ffa"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:00:19.908456 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-9dd9f35f-2da2-49f9-aab9-7be0ce871d39 req-0b2792d7-ee56-4ab0-81df-cf387e0df58d service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:19.908940 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-9dd9f35f-2da2-49f9-aab9-7be0ce871d39 req-0b2792d7-ee56-4ab0-81df-cf387e0df58d service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:19.909366 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-9dd9f35f-2da2-49f9-aab9-7be0ce871d39 req-0b2792d7-ee56-4ab0-81df-cf387e0df58d service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:19.921433 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-9dd9f35f-2da2-49f9-aab9-7be0ce871d39 req-0b2792d7-ee56-4ab0-81df-cf387e0df58d service nova] Creating event network-changed:f11c548b-432c-4945-bede-1e36e6933ffa for instance cfc21374-47be-4788-8ba9-e2f77ae73d6e on hv-cinder-81322 Sep 09 13:00:19.927349 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-9dd9f35f-2da2-49f9-aab9-7be0ce871d39 req-0b2792d7-ee56-4ab0-81df-cf387e0df58d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034099 Sep 09 13:00:19.931810 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 233/461] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:00:21.819100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ffa87dde-ffce-4f01-845a-d4c53e2b6f47 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-674450124"}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:00:21.819805 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ffa87dde-ffce-4f01-845a-d4c53e2b6f47 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:21.826354 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ffa87dde-ffce-4f01-845a-d4c53e2b6f47 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:21.826918 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ffa87dde-ffce-4f01-845a-d4c53e2b6f47 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:21.827966 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ffa87dde-ffce-4f01-845a-d4c53e2b6f47 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:21.828698 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ffa87dde-ffce-4f01-845a-d4c53e2b6f47 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:21.829132 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ffa87dde-ffce-4f01-845a-d4c53e2b6f47 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:21.829821 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ffa87dde-ffce-4f01-845a-d4c53e2b6f47 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:21.957437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.network.security_group_api [None req-ffa87dde-ffce-4f01-845a-d4c53e2b6f47 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Adding security group c4265b42-d283-41c0-81a4-54d8c0c55c38 to port 0f732f85-125a-41ad-8d5f-adfe587313de Sep 09 13:00:22.408529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ffa87dde-ffce-4f01-845a-d4c53e2b6f47 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "POST /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c/action" status: 202 len: 0 microversion: 2.1 time: 0.594067 Sep 09 13:00:22.409351 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 229/462] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 13:00:21 2022] POST /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c/action => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 13:00:22.417812 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-b9d29df8-b511-4ab8-bc79-d95a4047ab17 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:22.418526 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-b9d29df8-b511-4ab8-bc79-d95a4047ab17 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:22.425798 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b9d29df8-b511-4ab8-bc79-d95a4047ab17 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:22.426222 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b9d29df8-b511-4ab8-bc79-d95a4047ab17 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:22.426898 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b9d29df8-b511-4ab8-bc79-d95a4047ab17 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:22.427588 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b9d29df8-b511-4ab8-bc79-d95a4047ab17 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:22.428042 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b9d29df8-b511-4ab8-bc79-d95a4047ab17 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:22.428517 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b9d29df8-b511-4ab8-bc79-d95a4047ab17 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:22.438178 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-72f14f5b-28eb-4f1c-915c-3ba0ca6cb4d2 req-80653802-87f3-4345-a7a5-df52bfc13952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c", "tag": "0f732f85-125a-41ad-8d5f-adfe587313de"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:00:22.447733 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-72f14f5b-28eb-4f1c-915c-3ba0ca6cb4d2 req-80653802-87f3-4345-a7a5-df52bfc13952 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:22.448829 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-72f14f5b-28eb-4f1c-915c-3ba0ca6cb4d2 req-80653802-87f3-4345-a7a5-df52bfc13952 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:22.449451 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-72f14f5b-28eb-4f1c-915c-3ba0ca6cb4d2 req-80653802-87f3-4345-a7a5-df52bfc13952 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:22.464004 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-72f14f5b-28eb-4f1c-915c-3ba0ca6cb4d2 req-80653802-87f3-4345-a7a5-df52bfc13952 service nova] Creating event network-changed:0f732f85-125a-41ad-8d5f-adfe587313de for instance 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c on hv-cinder-81322 Sep 09 13:00:22.471109 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-72f14f5b-28eb-4f1c-915c-3ba0ca6cb4d2 req-80653802-87f3-4345-a7a5-df52bfc13952 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037551 Sep 09 13:00:22.475452 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 230/463] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:00:22.643146 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-b9d29df8-b511-4ab8-bc79-d95a4047ab17 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:22.651534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-b9d29df8-b511-4ab8-bc79-d95a4047ab17 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1759 microversion: 2.1 time: 0.237942 Sep 09 13:00:22.652192 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 234/464] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:22 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1759 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:23.896744 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-b07b3e0e-8da0-4b0d-90d4-e8d6e34b0aae tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:23.897316 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-b07b3e0e-8da0-4b0d-90d4-e8d6e34b0aae tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:23.903392 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b07b3e0e-8da0-4b0d-90d4-e8d6e34b0aae tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:23.903903 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b07b3e0e-8da0-4b0d-90d4-e8d6e34b0aae tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:23.904336 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b07b3e0e-8da0-4b0d-90d4-e8d6e34b0aae tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:23.906178 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b07b3e0e-8da0-4b0d-90d4-e8d6e34b0aae tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:23.906178 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b07b3e0e-8da0-4b0d-90d4-e8d6e34b0aae tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:23.906641 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b07b3e0e-8da0-4b0d-90d4-e8d6e34b0aae tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:23.938152 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-b07b3e0e-8da0-4b0d-90d4-e8d6e34b0aae tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1/os-volume_attachments/283eb5dd-fac2-4527-91e3-5ee223fbb869" status: 200 len: 194 microversion: 2.20 time: 0.046253 Sep 09 13:00:23.938762 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 231/465] 10.222.0.46 () {60 vars in 1454 bytes} [Fri Sep 9 13:00:23 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1/os-volume_attachments/283eb5dd-fac2-4527-91e3-5ee223fbb869 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:00:24.012985 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c2e05142-10d0-4822-b80d-f41a433094e3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:24.013767 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-c2e05142-10d0-4822-b80d-f41a433094e3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:24.020540 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c2e05142-10d0-4822-b80d-f41a433094e3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:24.021021 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c2e05142-10d0-4822-b80d-f41a433094e3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:24.021475 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c2e05142-10d0-4822-b80d-f41a433094e3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:24.022205 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c2e05142-10d0-4822-b80d-f41a433094e3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:24.022693 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c2e05142-10d0-4822-b80d-f41a433094e3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:24.023125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c2e05142-10d0-4822-b80d-f41a433094e3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:24.109746 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.objects.instance [None req-c2e05142-10d0-4822-b80d-f41a433094e3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lazy-loading 'services' on Instance uuid 78dad9a3-ac85-4014-829c-986cca18c8b1 {{(pid=127772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:00:24.333563 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-c2e05142-10d0-4822-b80d-f41a433094e3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "DELETE /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1/os-volume_attachments/283eb5dd-fac2-4527-91e3-5ee223fbb869" status: 202 len: 0 microversion: 2.20 time: 0.324627 Sep 09 13:00:24.334201 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 235/466] 10.222.0.46 () {60 vars in 1457 bytes} [Fri Sep 9 13:00:24 2022] DELETE /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1/os-volume_attachments/283eb5dd-fac2-4527-91e3-5ee223fbb869 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:00:24.342514 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8f985c5d-c18e-4885-85bf-eedf218bc180 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:24.346085 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-8f985c5d-c18e-4885-85bf-eedf218bc180 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:24.352315 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8f985c5d-c18e-4885-85bf-eedf218bc180 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:24.352800 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8f985c5d-c18e-4885-85bf-eedf218bc180 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:24.353236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8f985c5d-c18e-4885-85bf-eedf218bc180 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:24.353930 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8f985c5d-c18e-4885-85bf-eedf218bc180 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:24.354658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8f985c5d-c18e-4885-85bf-eedf218bc180 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:24.355073 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8f985c5d-c18e-4885-85bf-eedf218bc180 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:24.386103 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-8f985c5d-c18e-4885-85bf-eedf218bc180 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047498 Sep 09 13:00:24.386680 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 232/467] 10.222.0.46 () {60 vars in 1343 bytes} [Fri Sep 9 13:00:24 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:00:25.400085 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-9cf5aa76-696a-4ddd-82d7-4bd49a4e412c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:25.402312 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-9cf5aa76-696a-4ddd-82d7-4bd49a4e412c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:25.409076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9cf5aa76-696a-4ddd-82d7-4bd49a4e412c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:25.409669 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9cf5aa76-696a-4ddd-82d7-4bd49a4e412c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:25.410110 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9cf5aa76-696a-4ddd-82d7-4bd49a4e412c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:25.410826 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9cf5aa76-696a-4ddd-82d7-4bd49a4e412c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:25.411276 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9cf5aa76-696a-4ddd-82d7-4bd49a4e412c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:25.411698 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9cf5aa76-696a-4ddd-82d7-4bd49a4e412c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:25.441714 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-9cf5aa76-696a-4ddd-82d7-4bd49a4e412c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046233 Sep 09 13:00:25.442267 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 236/468] 10.222.0.46 () {60 vars in 1343 bytes} [Fri Sep 9 13:00:25 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:00:26.454185 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-b9821126-4640-4cc1-97d2-de44c8f10df6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:26.456599 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-b9821126-4640-4cc1-97d2-de44c8f10df6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:26.462942 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b9821126-4640-4cc1-97d2-de44c8f10df6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:26.463420 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b9821126-4640-4cc1-97d2-de44c8f10df6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:26.463852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b9821126-4640-4cc1-97d2-de44c8f10df6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:26.464531 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b9821126-4640-4cc1-97d2-de44c8f10df6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:26.464978 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b9821126-4640-4cc1-97d2-de44c8f10df6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:26.465402 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b9821126-4640-4cc1-97d2-de44c8f10df6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:26.495049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-b9821126-4640-4cc1-97d2-de44c8f10df6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045038 Sep 09 13:00:26.495582 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 233/469] 10.222.0.46 () {60 vars in 1343 bytes} [Fri Sep 9 13:00:26 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:26.560023 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-badf9b4a-0e83-49dd-aeaf-df2a72327c1a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:26.560533 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-badf9b4a-0e83-49dd-aeaf-df2a72327c1a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:26.566596 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-badf9b4a-0e83-49dd-aeaf-df2a72327c1a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:26.567078 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-badf9b4a-0e83-49dd-aeaf-df2a72327c1a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:26.567516 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-badf9b4a-0e83-49dd-aeaf-df2a72327c1a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:26.568204 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-badf9b4a-0e83-49dd-aeaf-df2a72327c1a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:26.568658 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-badf9b4a-0e83-49dd-aeaf-df2a72327c1a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:26.569202 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-badf9b4a-0e83-49dd-aeaf-df2a72327c1a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:26.594276 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-badf9b4a-0e83-49dd-aeaf-df2a72327c1a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Going to try to terminate instance {{(pid=127772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:00:26.852436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-badf9b4a-0e83-49dd-aeaf-df2a72327c1a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "DELETE /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 204 len: 0 microversion: 2.20 time: 0.295968 Sep 09 13:00:26.853022 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 237/470] 10.222.0.46 () {60 vars in 1280 bytes} [Fri Sep 9 13:00:26 2022] DELETE /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 13:00:26.862497 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-09fd6514-771b-44c7-b0f0-5d2b556e6769 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:26.863239 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-09fd6514-771b-44c7-b0f0-5d2b556e6769 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:26.869423 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-09fd6514-771b-44c7-b0f0-5d2b556e6769 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:26.869912 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-09fd6514-771b-44c7-b0f0-5d2b556e6769 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:26.870357 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-09fd6514-771b-44c7-b0f0-5d2b556e6769 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:26.871097 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-09fd6514-771b-44c7-b0f0-5d2b556e6769 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:26.871555 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-09fd6514-771b-44c7-b0f0-5d2b556e6769 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:26.871985 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-09fd6514-771b-44c7-b0f0-5d2b556e6769 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:27.013222 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-09fd6514-771b-44c7-b0f0-5d2b556e6769 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:27.024539 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-09fd6514-771b-44c7-b0f0-5d2b556e6769 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:27.026029 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-09fd6514-771b-44c7-b0f0-5d2b556e6769 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:27.027247 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-09fd6514-771b-44c7-b0f0-5d2b556e6769 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1723 microversion: 2.20 time: 0.169028 Sep 09 13:00:27.027804 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 234/471] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:00:26 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:00:28.057781 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-27f7e705-6edd-493d-b728-0fdca219889e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:28.058497 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-27f7e705-6edd-493d-b728-0fdca219889e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:28.064496 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-27f7e705-6edd-493d-b728-0fdca219889e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:28.064980 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-27f7e705-6edd-493d-b728-0fdca219889e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:28.065451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-27f7e705-6edd-493d-b728-0fdca219889e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:28.066310 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-27f7e705-6edd-493d-b728-0fdca219889e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:28.066834 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-27f7e705-6edd-493d-b728-0fdca219889e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:28.067264 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-27f7e705-6edd-493d-b728-0fdca219889e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:28.197043 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-27f7e705-6edd-493d-b728-0fdca219889e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:28.208952 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-27f7e705-6edd-493d-b728-0fdca219889e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:28.210388 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-27f7e705-6edd-493d-b728-0fdca219889e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:28.211587 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-27f7e705-6edd-493d-b728-0fdca219889e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1723 microversion: 2.20 time: 0.158079 Sep 09 13:00:28.212181 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 238/472] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:00:28 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:00:29.237593 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-32fd30b6-a021-425b-9130-4efbcee841d7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:29.238203 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-32fd30b6-a021-425b-9130-4efbcee841d7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:29.244992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-32fd30b6-a021-425b-9130-4efbcee841d7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:29.245474 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-32fd30b6-a021-425b-9130-4efbcee841d7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:29.245911 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-32fd30b6-a021-425b-9130-4efbcee841d7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:29.246639 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-32fd30b6-a021-425b-9130-4efbcee841d7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:29.247104 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-32fd30b6-a021-425b-9130-4efbcee841d7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:29.251266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-32fd30b6-a021-425b-9130-4efbcee841d7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:29.378999 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-32fd30b6-a021-425b-9130-4efbcee841d7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:29.387226 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-32fd30b6-a021-425b-9130-4efbcee841d7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:29.388723 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-32fd30b6-a021-425b-9130-4efbcee841d7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:29.390049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-32fd30b6-a021-425b-9130-4efbcee841d7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 200 len: 1723 microversion: 2.20 time: 0.156410 Sep 09 13:00:29.390765 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 235/473] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:00:29 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:00:29.709323 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-2202d347-b351-4673-a332-d894502e3643 req-0e7d3288-bd30-42c5-a321-925f1e15f175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78dad9a3-ac85-4014-829c-986cca18c8b1", "name": "network-vif-deleted", "tag": "244f1be5-c384-494f-b53f-53fb6f1b2689"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:00:29.726593 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-2202d347-b351-4673-a332-d894502e3643 req-0e7d3288-bd30-42c5-a321-925f1e15f175 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:29.726593 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-2202d347-b351-4673-a332-d894502e3643 req-0e7d3288-bd30-42c5-a321-925f1e15f175 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:29.726593 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-2202d347-b351-4673-a332-d894502e3643 req-0e7d3288-bd30-42c5-a321-925f1e15f175 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:29.736147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-2202d347-b351-4673-a332-d894502e3643 req-0e7d3288-bd30-42c5-a321-925f1e15f175 service nova] Creating event network-vif-deleted:244f1be5-c384-494f-b53f-53fb6f1b2689 for instance 78dad9a3-ac85-4014-829c-986cca18c8b1 on hv-cinder-81322 Sep 09 13:00:29.741069 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-2202d347-b351-4673-a332-d894502e3643 req-0e7d3288-bd30-42c5-a321-925f1e15f175 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035626 Sep 09 13:00:29.741844 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 239/474] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:00:30.420056 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-463181f7-e7bf-4e1b-a36b-41a3ae6b154e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:30.422000 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-463181f7-e7bf-4e1b-a36b-41a3ae6b154e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:30.433243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-463181f7-e7bf-4e1b-a36b-41a3ae6b154e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:30.434111 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-463181f7-e7bf-4e1b-a36b-41a3ae6b154e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:30.434964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-463181f7-e7bf-4e1b-a36b-41a3ae6b154e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:30.436247 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-463181f7-e7bf-4e1b-a36b-41a3ae6b154e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:30.437223 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-463181f7-e7bf-4e1b-a36b-41a3ae6b154e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:30.437994 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-463181f7-e7bf-4e1b-a36b-41a3ae6b154e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:30.462274 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-463181f7-e7bf-4e1b-a36b-41a3ae6b154e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] HTTP exception thrown: Instance 78dad9a3-ac85-4014-829c-986cca18c8b1 could not be found. Sep 09 13:00:30.464049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-463181f7-e7bf-4e1b-a36b-41a3ae6b154e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Request method failure captured: Sep 09 13:00:30.464049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 HTTP/1.1 Sep 09 13:00:30.464049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:00:30.464049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:00:30.464049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:00:30.464049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:00:30.464049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:00:30.464049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:00:30.464049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:00:30.464049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:00:30.464049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzgGc301qUdiFdvHsxfIR2ZHpj_jK1XgnS94H4zqb479BmFK7vk7y9IInkTzPaeassYzBWwIhwUIsIfb8PTxLo46qNMb8y_Xt7zHJgKoPsAssNKlApWDbag0xk_ORmkp1xzj2WRHJwvqOt_bRgXZoss1Uwz6Dfh7FIge5PagJd2rxig Sep 09 13:00:30.464049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:00:30.464049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:00:30.464049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:00:30.464049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:00:30.464049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 13:00:30.464049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:00:30.464049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:00:30.464049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: 8880382269b94daa8a25f92178a478d5 Sep 09 13:00:30.464049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1891493230 Sep 09 13:00:30.464049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:00:30.464049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:00:30.465744 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8880382269b94daa8a25f92178a478d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8880382269b94daa8a25f92178a478d5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8880382269b94daa8a25f92178a478d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8880382269b94daa8a25f92178a478d5"}]}] Sep 09 13:00:30.465744 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1891493230 Sep 09 13:00:30.465744 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: 8880382269b94daa8a25f92178a478d5 Sep 09 13:00:30.465744 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1891493230 Sep 09 13:00:30.465744 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-AttachVolumeShelveTestJSON-1891493230-project Sep 09 13:00:30.465744 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:00:30.465744 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:00:30.465744 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 6ec951604cde4768beb02906caf6d7c2 Sep 09 13:00:30.465744 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1891493230-project Sep 09 13:00:30.465744 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:00:30.465744 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance 78dad9a3-ac85-4014-829c-986cca18c8b1 could not be found. Sep 09 13:00:30.465744 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': '78dad9a3-ac85-4014-829c-986cca18c8b1'} Sep 09 13:00:30.470629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:00:30.470629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:00:30.470629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:00:30.470629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:00:30.470629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:00:30.470629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:00:30.470629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:00:30.470629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:00:30.470629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:00:30.470629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:00:30.470629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78dad9a3-ac85-4014-829c-986cca18c8b1 could not be found. Sep 09 13:00:30.470629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:00:30.470629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:00:30.470629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:00:30.470629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:00:30.470629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:00:30.470629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:00:30.470629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:00:30.470629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:00:30.470629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:00:30.472140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:00:30.472140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:00:30.472140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:00:30.472140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:00:30.472140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:00:30.472140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:00:30.472140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:00:30.472140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78dad9a3-ac85-4014-829c-986cca18c8b1 could not be found. Sep 09 13:00:30.472140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:00:30.472140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:00:30.472140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:00:30.472140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:00:30.472140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:00:30.472140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:00:30.472140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:00:30.472140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:00:30.472140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78dad9a3-ac85-4014-829c-986cca18c8b1 could not be found. Sep 09 13:00:30.472140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:00:30.473489 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-463181f7-e7bf-4e1b-a36b-41a3ae6b154e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Returning 404 to user: Instance 78dad9a3-ac85-4014-829c-986cca18c8b1 could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:00:30.473489 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-463181f7-e7bf-4e1b-a36b-41a3ae6b154e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 404 len: 111 microversion: 2.20 time: 0.052421 Sep 09 13:00:30.473489 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 236/475] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:00:30 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 13:00:30.475567 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-0d0a68e5-3541-40e8-b630-7037eeeec67e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '.version_select at 0x7f31831fbaf0>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:30.546458 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-0d0a68e5-3541-40e8-b630-7037eeeec67e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378395883" status: 204 len: 0 microversion: 2.20 time: 0.075012 Sep 09 13:00:30.547064 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 240/476] 10.222.0.46 () {60 vars in 1262 bytes} [Fri Sep 9 13:00:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378395883 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 13:00:31.325726 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-16608ac8-cd0f-4e2d-9cdd-404a5a8d98fa tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Action: 'create', calling method: .version_select at 0x7f31831961f0>, body: {"keypair": {"name": "tempest-keypair-1012367090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIg4Z7tPVNQ7yHER7JAyX0hX7X+AsBNEkHMpNT9yHe9zWvrBxLLc7rXavaIAiFvDxzDcAxbxCcbo5HhAgA0UI6ve+ymk0XsOmZC+JniU/YyI9VDshUdrpBoEf4r552Gr6Q=="}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:00:31.341333 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-16608ac8-cd0f-4e2d-9cdd-404a5a8d98fa tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Getting quotas for project 8880382269b94daa8a25f92178a478d5. Resources: {'key_pairs'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:00:31.345111 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-16608ac8-cd0f-4e2d-9cdd-404a5a8d98fa tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Getting quotas for user 6ec951604cde4768beb02906caf6d7c2 and project 8880382269b94daa8a25f92178a478d5. Resources: {'key_pairs'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:00:31.459188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-16608ac8-cd0f-4e2d-9cdd-404a5a8d98fa tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.137296 Sep 09 13:00:31.459863 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 237/477] 10.222.0.46 () {62 vars in 1200 bytes} [Fri Sep 9 13:00:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 139 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 09 13:00:33.792748 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-93cd1aa9-94d4-47ce-8e61-354db7e1812e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-26595009", "imageRef": "355bded2-2225-44b2-af86-f9e1861d05ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a798d8ea-1c3e-491f-9557-82b8ebb58c2c"}], "security_groups": [{"name": "tempest-securitygroup--57163462"}], "key_name": "tempest-keypair-1012367090", "user_data": "}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:00:33.801694 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:00:33.906100 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.network.neutron [None req-93cd1aa9-94d4-47ce-8e61-354db7e1812e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] validate_networks() for [('a798d8ea-1c3e-491f-9557-82b8ebb58c2c', None, None, None, None, None)] {{(pid=127772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:00:34.275925 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-93cd1aa9-94d4-47ce-8e61-354db7e1812e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Flavor limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:00:34.276355 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-93cd1aa9-94d4-47ce-8e61-354db7e1812e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Image limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:00:34.276828 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-93cd1aa9-94d4-47ce-8e61-354db7e1812e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Flavor pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:00:34.277455 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-93cd1aa9-94d4-47ce-8e61-354db7e1812e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Image pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:00:34.277870 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-93cd1aa9-94d4-47ce-8e61-354db7e1812e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:00:34.287636 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-93cd1aa9-94d4-47ce-8e61-354db7e1812e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:34.288116 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-93cd1aa9-94d4-47ce-8e61-354db7e1812e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:34.288544 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-93cd1aa9-94d4-47ce-8e61-354db7e1812e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:34.289265 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-93cd1aa9-94d4-47ce-8e61-354db7e1812e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:34.289714 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-93cd1aa9-94d4-47ce-8e61-354db7e1812e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:34.290135 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-93cd1aa9-94d4-47ce-8e61-354db7e1812e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:34.296889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:00:34.307357 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-93cd1aa9-94d4-47ce-8e61-354db7e1812e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Getting quotas for project 8880382269b94daa8a25f92178a478d5. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:00:34.311261 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-93cd1aa9-94d4-47ce-8e61-354db7e1812e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Getting quotas for user 6ec951604cde4768beb02906caf6d7c2 and project 8880382269b94daa8a25f92178a478d5. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:00:34.322803 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-93cd1aa9-94d4-47ce-8e61-354db7e1812e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Going to run 1 instances... {{(pid=127772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:00:34.328003 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-93cd1aa9-94d4-47ce-8e61-354db7e1812e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='355bded2-2225-44b2-af86-f9e1861d05ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:00:34.477882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-93cd1aa9-94d4-47ce-8e61-354db7e1812e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.689649 Sep 09 13:00:34.478573 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 241/478] 10.222.0.46 () {62 vars in 1188 bytes} [Fri Sep 9 13:00:33 2022] POST /compute/v2.1/servers => generated 400 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 09 13:00:34.490727 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2aab7575-f8e2-49c0-895d-410850955ff9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:34.492104 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2aab7575-f8e2-49c0-895d-410850955ff9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:34.550363 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2aab7575-f8e2-49c0-895d-410850955ff9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:34.559244 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2aab7575-f8e2-49c0-895d-410850955ff9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:34.560958 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2aab7575-f8e2-49c0-895d-410850955ff9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:34.562121 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2aab7575-f8e2-49c0-895d-410850955ff9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1280 microversion: 2.20 time: 0.075998 Sep 09 13:00:34.569477 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 238/479] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:00:34 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:00:35.588155 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-70b7cc69-18dd-40b6-bc2e-37e59b10acbc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:35.588980 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-70b7cc69-18dd-40b6-bc2e-37e59b10acbc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:35.596108 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-70b7cc69-18dd-40b6-bc2e-37e59b10acbc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:35.596582 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-70b7cc69-18dd-40b6-bc2e-37e59b10acbc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:35.597022 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-70b7cc69-18dd-40b6-bc2e-37e59b10acbc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:35.597734 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-70b7cc69-18dd-40b6-bc2e-37e59b10acbc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:35.598182 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-70b7cc69-18dd-40b6-bc2e-37e59b10acbc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:35.598636 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-70b7cc69-18dd-40b6-bc2e-37e59b10acbc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:35.665630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-70b7cc69-18dd-40b6-bc2e-37e59b10acbc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:35.673971 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-70b7cc69-18dd-40b6-bc2e-37e59b10acbc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:35.675442 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-70b7cc69-18dd-40b6-bc2e-37e59b10acbc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:35.676549 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-70b7cc69-18dd-40b6-bc2e-37e59b10acbc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1284 microversion: 2.20 time: 0.092435 Sep 09 13:00:35.677108 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 242/480] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:00:35 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:00:36.701591 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ff64377f-88b3-458f-994f-089c751a3269 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:36.702265 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ff64377f-88b3-458f-994f-089c751a3269 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:36.709454 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff64377f-88b3-458f-994f-089c751a3269 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:36.709950 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff64377f-88b3-458f-994f-089c751a3269 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:36.710394 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff64377f-88b3-458f-994f-089c751a3269 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:36.711157 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff64377f-88b3-458f-994f-089c751a3269 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:36.711613 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff64377f-88b3-458f-994f-089c751a3269 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:36.712045 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff64377f-88b3-458f-994f-089c751a3269 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:36.714981 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:00:36.782004 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ff64377f-88b3-458f-994f-089c751a3269 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:36.790509 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ff64377f-88b3-458f-994f-089c751a3269 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:36.791894 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ff64377f-88b3-458f-994f-089c751a3269 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:36.793022 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ff64377f-88b3-458f-994f-089c751a3269 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1340 microversion: 2.20 time: 0.095487 Sep 09 13:00:36.793578 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 239/481] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:00:36 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1340 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:00:37.825097 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a69738ab-ab91-4533-adb0-b9b53499a2e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:37.825706 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a69738ab-ab91-4533-adb0-b9b53499a2e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:37.831993 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a69738ab-ab91-4533-adb0-b9b53499a2e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:37.832479 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a69738ab-ab91-4533-adb0-b9b53499a2e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:37.832905 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a69738ab-ab91-4533-adb0-b9b53499a2e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:37.833592 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a69738ab-ab91-4533-adb0-b9b53499a2e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:37.834089 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a69738ab-ab91-4533-adb0-b9b53499a2e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:37.834844 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a69738ab-ab91-4533-adb0-b9b53499a2e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:38.028727 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a69738ab-ab91-4533-adb0-b9b53499a2e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:38.037687 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a69738ab-ab91-4533-adb0-b9b53499a2e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:38.039184 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a69738ab-ab91-4533-adb0-b9b53499a2e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:38.040345 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a69738ab-ab91-4533-adb0-b9b53499a2e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1404 microversion: 2.20 time: 0.219179 Sep 09 13:00:38.044743 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 243/482] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:00:37 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1404 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:00:38.655891 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-cb4fe1c6-9e26-4aa9-ac0f-470849a6a98a req-e8706837-64a6-4b9c-bdad-4727fbdda332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37305bac-ecac-4f89-a340-55d5ffc7a775", "tag": "10813693-1d59-4806-bfad-10fa8cfeba3b"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:00:38.668096 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-cb4fe1c6-9e26-4aa9-ac0f-470849a6a98a req-e8706837-64a6-4b9c-bdad-4727fbdda332 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:38.668593 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-cb4fe1c6-9e26-4aa9-ac0f-470849a6a98a req-e8706837-64a6-4b9c-bdad-4727fbdda332 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:38.669020 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-cb4fe1c6-9e26-4aa9-ac0f-470849a6a98a req-e8706837-64a6-4b9c-bdad-4727fbdda332 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:38.681392 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-cb4fe1c6-9e26-4aa9-ac0f-470849a6a98a req-e8706837-64a6-4b9c-bdad-4727fbdda332 service nova] Creating event network-changed:10813693-1d59-4806-bfad-10fa8cfeba3b for instance 37305bac-ecac-4f89-a340-55d5ffc7a775 on hv-cinder-81322 Sep 09 13:00:38.687014 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-cb4fe1c6-9e26-4aa9-ac0f-470849a6a98a req-e8706837-64a6-4b9c-bdad-4727fbdda332 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034948 Sep 09 13:00:38.688174 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 240/483] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:00:39.065641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e2a08a07-a06d-4d77-b13d-8fe6e19fe1f9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:39.066258 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e2a08a07-a06d-4d77-b13d-8fe6e19fe1f9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:39.072194 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e2a08a07-a06d-4d77-b13d-8fe6e19fe1f9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:39.072683 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e2a08a07-a06d-4d77-b13d-8fe6e19fe1f9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:39.073120 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e2a08a07-a06d-4d77-b13d-8fe6e19fe1f9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:39.073882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e2a08a07-a06d-4d77-b13d-8fe6e19fe1f9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:39.074344 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e2a08a07-a06d-4d77-b13d-8fe6e19fe1f9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:39.074811 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e2a08a07-a06d-4d77-b13d-8fe6e19fe1f9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:39.272888 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e2a08a07-a06d-4d77-b13d-8fe6e19fe1f9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:39.281175 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e2a08a07-a06d-4d77-b13d-8fe6e19fe1f9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:39.283519 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e2a08a07-a06d-4d77-b13d-8fe6e19fe1f9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:39.284367 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e2a08a07-a06d-4d77-b13d-8fe6e19fe1f9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1404 microversion: 2.20 time: 0.222783 Sep 09 13:00:39.284927 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 244/484] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:00:39 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1404 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:00:40.310113 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e908a718-4e16-4ce8-b16e-77bd7767ee70 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:40.310850 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-e908a718-4e16-4ce8-b16e-77bd7767ee70 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:40.319150 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e908a718-4e16-4ce8-b16e-77bd7767ee70 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:40.324710 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e908a718-4e16-4ce8-b16e-77bd7767ee70 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:40.324710 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e908a718-4e16-4ce8-b16e-77bd7767ee70 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:40.324710 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e908a718-4e16-4ce8-b16e-77bd7767ee70 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:40.324710 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e908a718-4e16-4ce8-b16e-77bd7767ee70 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:40.325146 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e908a718-4e16-4ce8-b16e-77bd7767ee70 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:40.448720 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e908a718-4e16-4ce8-b16e-77bd7767ee70 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:40.457515 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e908a718-4e16-4ce8-b16e-77bd7767ee70 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:40.458974 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e908a718-4e16-4ce8-b16e-77bd7767ee70 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:40.460067 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-e908a718-4e16-4ce8-b16e-77bd7767ee70 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1404 microversion: 2.20 time: 0.154510 Sep 09 13:00:40.460621 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 241/485] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:00:40 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:00:41.485725 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a76db771-9c79-41f5-b19d-b75a6b82539f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:41.486427 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a76db771-9c79-41f5-b19d-b75a6b82539f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:41.492402 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a76db771-9c79-41f5-b19d-b75a6b82539f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:41.492903 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a76db771-9c79-41f5-b19d-b75a6b82539f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:41.493335 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a76db771-9c79-41f5-b19d-b75a6b82539f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:41.494019 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a76db771-9c79-41f5-b19d-b75a6b82539f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:41.494469 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a76db771-9c79-41f5-b19d-b75a6b82539f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:41.494917 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a76db771-9c79-41f5-b19d-b75a6b82539f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:41.622159 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a76db771-9c79-41f5-b19d-b75a6b82539f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:41.630406 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a76db771-9c79-41f5-b19d-b75a6b82539f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:41.631890 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a76db771-9c79-41f5-b19d-b75a6b82539f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:41.632987 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a76db771-9c79-41f5-b19d-b75a6b82539f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1404 microversion: 2.20 time: 0.151744 Sep 09 13:00:41.633552 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 245/486] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:00:41 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:00:42.657351 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8bd050f5-f8a8-4021-adcb-262e059c3df6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:42.658563 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-8bd050f5-f8a8-4021-adcb-262e059c3df6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:42.664990 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8bd050f5-f8a8-4021-adcb-262e059c3df6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:42.665472 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8bd050f5-f8a8-4021-adcb-262e059c3df6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:42.665911 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8bd050f5-f8a8-4021-adcb-262e059c3df6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:42.666626 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8bd050f5-f8a8-4021-adcb-262e059c3df6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:42.667080 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8bd050f5-f8a8-4021-adcb-262e059c3df6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:42.667510 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8bd050f5-f8a8-4021-adcb-262e059c3df6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:42.795106 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-8bd050f5-f8a8-4021-adcb-262e059c3df6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:42.803903 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-8bd050f5-f8a8-4021-adcb-262e059c3df6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:42.805359 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-8bd050f5-f8a8-4021-adcb-262e059c3df6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:42.806466 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-8bd050f5-f8a8-4021-adcb-262e059c3df6 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1404 microversion: 2.20 time: 0.153080 Sep 09 13:00:42.807049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 242/487] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:00:42 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:00:43.832590 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e373fddc-1047-42a8-bbea-acd35122389f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:43.833235 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e373fddc-1047-42a8-bbea-acd35122389f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:43.839190 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e373fddc-1047-42a8-bbea-acd35122389f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:43.839682 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e373fddc-1047-42a8-bbea-acd35122389f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:43.840171 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e373fddc-1047-42a8-bbea-acd35122389f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:43.840817 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e373fddc-1047-42a8-bbea-acd35122389f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:43.841275 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e373fddc-1047-42a8-bbea-acd35122389f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:43.841701 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e373fddc-1047-42a8-bbea-acd35122389f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:43.974982 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e373fddc-1047-42a8-bbea-acd35122389f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:43.983091 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e373fddc-1047-42a8-bbea-acd35122389f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:43.984568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e373fddc-1047-42a8-bbea-acd35122389f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:43.985668 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e373fddc-1047-42a8-bbea-acd35122389f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1404 microversion: 2.20 time: 0.157922 Sep 09 13:00:43.987012 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 246/488] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:00:43 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:00:44.319089 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-7efa872b-98aa-44ab-afb6-ecca3271cbac req-6fa62ccd-c279-4c90-a76f-b51b7d4db014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37305bac-ecac-4f89-a340-55d5ffc7a775", "name": "network-vif-plugged", "status": "completed", "tag": "10813693-1d59-4806-bfad-10fa8cfeba3b"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:00:44.329533 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-7efa872b-98aa-44ab-afb6-ecca3271cbac req-6fa62ccd-c279-4c90-a76f-b51b7d4db014 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:44.330352 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-7efa872b-98aa-44ab-afb6-ecca3271cbac req-6fa62ccd-c279-4c90-a76f-b51b7d4db014 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:44.330808 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-7efa872b-98aa-44ab-afb6-ecca3271cbac req-6fa62ccd-c279-4c90-a76f-b51b7d4db014 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:44.341886 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-7efa872b-98aa-44ab-afb6-ecca3271cbac req-6fa62ccd-c279-4c90-a76f-b51b7d4db014 service nova] Creating event network-vif-plugged:10813693-1d59-4806-bfad-10fa8cfeba3b for instance 37305bac-ecac-4f89-a340-55d5ffc7a775 on hv-cinder-81322 Sep 09 13:00:44.348042 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-7efa872b-98aa-44ab-afb6-ecca3271cbac req-6fa62ccd-c279-4c90-a76f-b51b7d4db014 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032707 Sep 09 13:00:44.348724 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 243/489] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:00:45.012117 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e4302aa8-fb44-4847-a443-3b72f8aaa561 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:45.012732 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e4302aa8-fb44-4847-a443-3b72f8aaa561 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:45.014629 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=2 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:00:45.015319 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=6 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:00:45.020638 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e4302aa8-fb44-4847-a443-3b72f8aaa561 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:45.021114 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e4302aa8-fb44-4847-a443-3b72f8aaa561 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:45.021546 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e4302aa8-fb44-4847-a443-3b72f8aaa561 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:45.022390 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e4302aa8-fb44-4847-a443-3b72f8aaa561 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:45.022872 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e4302aa8-fb44-4847-a443-3b72f8aaa561 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:45.023297 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e4302aa8-fb44-4847-a443-3b72f8aaa561 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:45.161613 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e4302aa8-fb44-4847-a443-3b72f8aaa561 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:45.169772 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e4302aa8-fb44-4847-a443-3b72f8aaa561 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:45.171255 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e4302aa8-fb44-4847-a443-3b72f8aaa561 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:45.172370 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e4302aa8-fb44-4847-a443-3b72f8aaa561 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1404 microversion: 2.20 time: 0.164364 Sep 09 13:00:45.172939 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 247/490] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:00:45 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:00:46.195607 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=6 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:00:46.200509 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-238de7ce-38dc-4465-8937-60c2940a2d53 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:46.201235 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-238de7ce-38dc-4465-8937-60c2940a2d53 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:46.207998 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-238de7ce-38dc-4465-8937-60c2940a2d53 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:46.208481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-238de7ce-38dc-4465-8937-60c2940a2d53 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:46.208968 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-238de7ce-38dc-4465-8937-60c2940a2d53 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:46.209654 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-238de7ce-38dc-4465-8937-60c2940a2d53 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:46.210102 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-238de7ce-38dc-4465-8937-60c2940a2d53 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:46.210543 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-238de7ce-38dc-4465-8937-60c2940a2d53 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:46.347943 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-238de7ce-38dc-4465-8937-60c2940a2d53 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:46.356083 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-238de7ce-38dc-4465-8937-60c2940a2d53 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:46.357538 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-238de7ce-38dc-4465-8937-60c2940a2d53 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:46.358725 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-238de7ce-38dc-4465-8937-60c2940a2d53 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1404 microversion: 2.20 time: 0.164076 Sep 09 13:00:46.359504 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 244/491] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:00:46 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:00:47.384301 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-fb9cb504-a494-40cd-8c04-1c0ea4ef1d13 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:47.384863 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-fb9cb504-a494-40cd-8c04-1c0ea4ef1d13 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:47.390875 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fb9cb504-a494-40cd-8c04-1c0ea4ef1d13 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:47.391357 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fb9cb504-a494-40cd-8c04-1c0ea4ef1d13 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:47.391796 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fb9cb504-a494-40cd-8c04-1c0ea4ef1d13 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:47.392874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fb9cb504-a494-40cd-8c04-1c0ea4ef1d13 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:47.393332 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fb9cb504-a494-40cd-8c04-1c0ea4ef1d13 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:47.393769 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fb9cb504-a494-40cd-8c04-1c0ea4ef1d13 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:47.528283 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-fb9cb504-a494-40cd-8c04-1c0ea4ef1d13 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:47.537025 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-fb9cb504-a494-40cd-8c04-1c0ea4ef1d13 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:47.538492 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-fb9cb504-a494-40cd-8c04-1c0ea4ef1d13 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:47.539653 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-fb9cb504-a494-40cd-8c04-1c0ea4ef1d13 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1595 microversion: 2.20 time: 0.159529 Sep 09 13:00:47.540204 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 248/492] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:00:47 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1595 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:00:47.564454 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-6cbc28cd-da58-42cd-92b9-ccfdc7e3b3ac tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:47.564964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-6cbc28cd-da58-42cd-92b9-ccfdc7e3b3ac tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:47.570822 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6cbc28cd-da58-42cd-92b9-ccfdc7e3b3ac tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:47.571310 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6cbc28cd-da58-42cd-92b9-ccfdc7e3b3ac tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:47.571746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6cbc28cd-da58-42cd-92b9-ccfdc7e3b3ac tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:47.572440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6cbc28cd-da58-42cd-92b9-ccfdc7e3b3ac tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:47.572895 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6cbc28cd-da58-42cd-92b9-ccfdc7e3b3ac tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:47.573322 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6cbc28cd-da58-42cd-92b9-ccfdc7e3b3ac tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:47.650081 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-6cbc28cd-da58-42cd-92b9-ccfdc7e3b3ac tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089749 Sep 09 13:00:47.650742 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 245/493] 10.222.0.46 () {60 vars in 1316 bytes} [Fri Sep 9 13:00:47 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:00:48.280456 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-46121499-2bcd-430d-bc28-f6b9cce8ab62 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:00:48.283422 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-46121499-2bcd-430d-bc28-f6b9cce8ab62 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:48.289857 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-46121499-2bcd-430d-bc28-f6b9cce8ab62 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:48.290377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-46121499-2bcd-430d-bc28-f6b9cce8ab62 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:48.290847 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-46121499-2bcd-430d-bc28-f6b9cce8ab62 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:48.291550 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-46121499-2bcd-430d-bc28-f6b9cce8ab62 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:48.292003 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-46121499-2bcd-430d-bc28-f6b9cce8ab62 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:48.292428 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-46121499-2bcd-430d-bc28-f6b9cce8ab62 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:48.541530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-46121499-2bcd-430d-bc28-f6b9cce8ab62 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "POST /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c/action" status: 202 len: 0 microversion: 2.1 time: 0.264932 Sep 09 13:00:48.545395 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 249/494] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 13:00:48 2022] POST /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:00:48.552659 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d239aa92-7052-4198-a0fa-0cbd547dffd8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:48.553533 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-d239aa92-7052-4198-a0fa-0cbd547dffd8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:48.560236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d239aa92-7052-4198-a0fa-0cbd547dffd8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:48.560754 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d239aa92-7052-4198-a0fa-0cbd547dffd8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:48.561199 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d239aa92-7052-4198-a0fa-0cbd547dffd8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:48.561895 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d239aa92-7052-4198-a0fa-0cbd547dffd8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:48.562351 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d239aa92-7052-4198-a0fa-0cbd547dffd8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:48.562814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d239aa92-7052-4198-a0fa-0cbd547dffd8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:48.673179 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-369422d1-2e30-423a-b1df-3c109f6596b5 req-faa83984-afe8-47c5-94e3-d6b4d8609e2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37305bac-ecac-4f89-a340-55d5ffc7a775", "tag": "10813693-1d59-4806-bfad-10fa8cfeba3b"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:00:48.686517 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-369422d1-2e30-423a-b1df-3c109f6596b5 req-faa83984-afe8-47c5-94e3-d6b4d8609e2a service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:48.687458 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-369422d1-2e30-423a-b1df-3c109f6596b5 req-faa83984-afe8-47c5-94e3-d6b4d8609e2a service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:48.688156 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-369422d1-2e30-423a-b1df-3c109f6596b5 req-faa83984-afe8-47c5-94e3-d6b4d8609e2a service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:48.707030 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-369422d1-2e30-423a-b1df-3c109f6596b5 req-faa83984-afe8-47c5-94e3-d6b4d8609e2a service nova] Creating event network-changed:10813693-1d59-4806-bfad-10fa8cfeba3b for instance 37305bac-ecac-4f89-a340-55d5ffc7a775 on hv-cinder-81322 Sep 09 13:00:48.713127 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-369422d1-2e30-423a-b1df-3c109f6596b5 req-faa83984-afe8-47c5-94e3-d6b4d8609e2a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043879 Sep 09 13:00:48.714692 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 250/495] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:00:48.757769 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-d239aa92-7052-4198-a0fa-0cbd547dffd8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:48.773075 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d239aa92-7052-4198-a0fa-0cbd547dffd8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1751 microversion: 2.1 time: 0.226550 Sep 09 13:00:48.773889 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 246/496] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:48 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1751 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:00:49.799702 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-b669e71f-2e2f-490d-8553-37915be7a366 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:49.800384 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-b669e71f-2e2f-490d-8553-37915be7a366 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:49.806603 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b669e71f-2e2f-490d-8553-37915be7a366 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:49.807089 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b669e71f-2e2f-490d-8553-37915be7a366 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:49.810753 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b669e71f-2e2f-490d-8553-37915be7a366 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:49.810753 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b669e71f-2e2f-490d-8553-37915be7a366 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:49.810753 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b669e71f-2e2f-490d-8553-37915be7a366 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:49.810753 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b669e71f-2e2f-490d-8553-37915be7a366 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:49.962638 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-b669e71f-2e2f-490d-8553-37915be7a366 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:49.971169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-b669e71f-2e2f-490d-8553-37915be7a366 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1751 microversion: 2.1 time: 0.175920 Sep 09 13:00:49.971727 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 251/497] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:49 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:50.994865 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-09ddebdd-4ec8-4acf-bcb0-58b8435e9dc4 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:50.995474 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-09ddebdd-4ec8-4acf-bcb0-58b8435e9dc4 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:51.001951 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-09ddebdd-4ec8-4acf-bcb0-58b8435e9dc4 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:51.002425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-09ddebdd-4ec8-4acf-bcb0-58b8435e9dc4 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:51.002889 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-09ddebdd-4ec8-4acf-bcb0-58b8435e9dc4 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:51.003565 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-09ddebdd-4ec8-4acf-bcb0-58b8435e9dc4 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:51.004012 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-09ddebdd-4ec8-4acf-bcb0-58b8435e9dc4 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:51.004431 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-09ddebdd-4ec8-4acf-bcb0-58b8435e9dc4 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:51.148039 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-09ddebdd-4ec8-4acf-bcb0-58b8435e9dc4 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:51.156261 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-09ddebdd-4ec8-4acf-bcb0-58b8435e9dc4 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1756 microversion: 2.1 time: 0.165408 Sep 09 13:00:51.156817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 247/498] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:50 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:52.180058 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-08e33433-8cb5-4f58-bd71-46ecac1ac422 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:52.180668 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-08e33433-8cb5-4f58-bd71-46ecac1ac422 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:52.186781 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-08e33433-8cb5-4f58-bd71-46ecac1ac422 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:52.187270 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-08e33433-8cb5-4f58-bd71-46ecac1ac422 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:52.187704 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-08e33433-8cb5-4f58-bd71-46ecac1ac422 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:52.188389 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-08e33433-8cb5-4f58-bd71-46ecac1ac422 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:52.188842 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-08e33433-8cb5-4f58-bd71-46ecac1ac422 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:52.189271 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-08e33433-8cb5-4f58-bd71-46ecac1ac422 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:52.332744 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-08e33433-8cb5-4f58-bd71-46ecac1ac422 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:52.340877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-08e33433-8cb5-4f58-bd71-46ecac1ac422 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1756 microversion: 2.1 time: 0.164747 Sep 09 13:00:52.341433 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 252/499] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:52 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:53.364728 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-9884fd1b-9a4c-43b2-9765-5018458ff092 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:53.365338 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-9884fd1b-9a4c-43b2-9765-5018458ff092 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:53.367667 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:00:53.372390 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9884fd1b-9a4c-43b2-9765-5018458ff092 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:53.372912 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9884fd1b-9a4c-43b2-9765-5018458ff092 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:53.373350 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9884fd1b-9a4c-43b2-9765-5018458ff092 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:53.374085 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9884fd1b-9a4c-43b2-9765-5018458ff092 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:53.374504 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9884fd1b-9a4c-43b2-9765-5018458ff092 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:53.375032 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9884fd1b-9a4c-43b2-9765-5018458ff092 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:53.515894 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-9884fd1b-9a4c-43b2-9765-5018458ff092 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:53.524640 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-9884fd1b-9a4c-43b2-9765-5018458ff092 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1756 microversion: 2.1 time: 0.164755 Sep 09 13:00:53.525203 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 248/500] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:53 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:54.548775 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-12c736e7-a9a4-4f96-9fc5-287bf8c4ac5f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:54.549394 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-12c736e7-a9a4-4f96-9fc5-287bf8c4ac5f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:54.555401 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-12c736e7-a9a4-4f96-9fc5-287bf8c4ac5f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:54.555881 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-12c736e7-a9a4-4f96-9fc5-287bf8c4ac5f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:54.556314 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-12c736e7-a9a4-4f96-9fc5-287bf8c4ac5f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:54.557003 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-12c736e7-a9a4-4f96-9fc5-287bf8c4ac5f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:54.557454 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-12c736e7-a9a4-4f96-9fc5-287bf8c4ac5f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:54.557878 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-12c736e7-a9a4-4f96-9fc5-287bf8c4ac5f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:54.701108 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-12c736e7-a9a4-4f96-9fc5-287bf8c4ac5f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:54.711698 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-12c736e7-a9a4-4f96-9fc5-287bf8c4ac5f tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1756 microversion: 2.1 time: 0.166921 Sep 09 13:00:54.712287 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 253/501] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:54 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:55.735640 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-4651647a-9066-40e1-9c53-0bcdf46eea21 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:55.736509 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-4651647a-9066-40e1-9c53-0bcdf46eea21 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:55.742894 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4651647a-9066-40e1-9c53-0bcdf46eea21 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:55.743388 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4651647a-9066-40e1-9c53-0bcdf46eea21 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:55.743831 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4651647a-9066-40e1-9c53-0bcdf46eea21 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:55.744520 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4651647a-9066-40e1-9c53-0bcdf46eea21 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:55.744982 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4651647a-9066-40e1-9c53-0bcdf46eea21 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:55.745413 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4651647a-9066-40e1-9c53-0bcdf46eea21 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:55.884574 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-4651647a-9066-40e1-9c53-0bcdf46eea21 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:55.893384 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-4651647a-9066-40e1-9c53-0bcdf46eea21 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1756 microversion: 2.1 time: 0.161705 Sep 09 13:00:55.893948 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 249/502] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:55 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:56.075770 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-5b53aadb-200b-4812-89b8-a166e24e3a26 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9312c3c4-1c94-4c77-af62-829ae7f9f574"}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:00:56.078063 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-5b53aadb-200b-4812-89b8-a166e24e3a26 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:56.084441 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5b53aadb-200b-4812-89b8-a166e24e3a26 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:56.084922 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5b53aadb-200b-4812-89b8-a166e24e3a26 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:56.085350 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5b53aadb-200b-4812-89b8-a166e24e3a26 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:56.086030 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5b53aadb-200b-4812-89b8-a166e24e3a26 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:56.086508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5b53aadb-200b-4812-89b8-a166e24e3a26 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:56.086921 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5b53aadb-200b-4812-89b8-a166e24e3a26 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:56.789218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-5b53aadb-200b-4812-89b8-a166e24e3a26 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "POST /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.717211 Sep 09 13:00:56.789881 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 254/503] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 13:00:56 2022] POST /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments => generated 194 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:00:56.916563 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e12c1ec7-ce60-4f6f-b114-998830ffd2ed tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:56.917208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-e12c1ec7-ce60-4f6f-b114-998830ffd2ed tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:56.923967 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e12c1ec7-ce60-4f6f-b114-998830ffd2ed tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:56.924459 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e12c1ec7-ce60-4f6f-b114-998830ffd2ed tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:56.924901 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e12c1ec7-ce60-4f6f-b114-998830ffd2ed tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:56.925603 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e12c1ec7-ce60-4f6f-b114-998830ffd2ed tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:56.926061 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e12c1ec7-ce60-4f6f-b114-998830ffd2ed tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:56.926505 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e12c1ec7-ce60-4f6f-b114-998830ffd2ed tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:57.071123 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e12c1ec7-ce60-4f6f-b114-998830ffd2ed tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:57.080169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-e12c1ec7-ce60-4f6f-b114-998830ffd2ed tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1756 microversion: 2.1 time: 0.166737 Sep 09 13:00:57.084793 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 250/504] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:56 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:58.105328 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-8b85b4a0-b924-4015-80a1-f440a035231c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:58.106017 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-8b85b4a0-b924-4015-80a1-f440a035231c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:58.113574 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8b85b4a0-b924-4015-80a1-f440a035231c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:58.114058 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8b85b4a0-b924-4015-80a1-f440a035231c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:58.114508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8b85b4a0-b924-4015-80a1-f440a035231c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:58.115207 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8b85b4a0-b924-4015-80a1-f440a035231c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:58.115659 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8b85b4a0-b924-4015-80a1-f440a035231c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:58.116079 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8b85b4a0-b924-4015-80a1-f440a035231c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:58.259943 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-8b85b4a0-b924-4015-80a1-f440a035231c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:58.266959 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-8b85b4a0-b924-4015-80a1-f440a035231c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1756 microversion: 2.1 time: 0.166359 Sep 09 13:00:58.268023 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 255/505] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:58 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:00:59.296933 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2464a0a1-a4f8-4729-8b61-8f5c2d0271f8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:00:59.297580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2464a0a1-a4f8-4729-8b61-8f5c2d0271f8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:00:59.304063 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2464a0a1-a4f8-4729-8b61-8f5c2d0271f8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:59.304548 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2464a0a1-a4f8-4729-8b61-8f5c2d0271f8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:59.304993 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2464a0a1-a4f8-4729-8b61-8f5c2d0271f8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:59.305682 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2464a0a1-a4f8-4729-8b61-8f5c2d0271f8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:00:59.306137 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2464a0a1-a4f8-4729-8b61-8f5c2d0271f8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:00:59.306594 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2464a0a1-a4f8-4729-8b61-8f5c2d0271f8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:00:59.449845 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2464a0a1-a4f8-4729-8b61-8f5c2d0271f8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:00:59.458454 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2464a0a1-a4f8-4729-8b61-8f5c2d0271f8 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1756 microversion: 2.1 time: 0.165257 Sep 09 13:00:59.459056 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 251/506] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:00:59 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:00.483879 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-bbddd166-2bfe-461e-a26c-cdf9ca3c7a75 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:00.484511 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-bbddd166-2bfe-461e-a26c-cdf9ca3c7a75 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:00.491139 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bbddd166-2bfe-461e-a26c-cdf9ca3c7a75 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:00.491630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bbddd166-2bfe-461e-a26c-cdf9ca3c7a75 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:00.492079 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bbddd166-2bfe-461e-a26c-cdf9ca3c7a75 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:00.492781 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bbddd166-2bfe-461e-a26c-cdf9ca3c7a75 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:00.493239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bbddd166-2bfe-461e-a26c-cdf9ca3c7a75 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:00.493666 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bbddd166-2bfe-461e-a26c-cdf9ca3c7a75 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:00.638042 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-bbddd166-2bfe-461e-a26c-cdf9ca3c7a75 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:00.639007 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:01:00.644871 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-bbddd166-2bfe-461e-a26c-cdf9ca3c7a75 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1756 microversion: 2.1 time: 0.167368 Sep 09 13:01:00.645444 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 256/507] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:00 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:01.668322 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-fb4ab907-12f5-44cd-a4d6-9150cd5248b9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:01.668932 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-fb4ab907-12f5-44cd-a4d6-9150cd5248b9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:01.676495 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fb4ab907-12f5-44cd-a4d6-9150cd5248b9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:01.676972 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fb4ab907-12f5-44cd-a4d6-9150cd5248b9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:01.677407 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fb4ab907-12f5-44cd-a4d6-9150cd5248b9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:01.678094 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fb4ab907-12f5-44cd-a4d6-9150cd5248b9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:01.678577 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fb4ab907-12f5-44cd-a4d6-9150cd5248b9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:01.679006 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fb4ab907-12f5-44cd-a4d6-9150cd5248b9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:01.831265 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-fb4ab907-12f5-44cd-a4d6-9150cd5248b9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:01.839418 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-fb4ab907-12f5-44cd-a4d6-9150cd5248b9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1756 microversion: 2.1 time: 0.174978 Sep 09 13:01:01.839990 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 252/508] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:01 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:02.864264 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-56aeae72-9d88-4b20-8c44-e125bb249de9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:02.864895 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-56aeae72-9d88-4b20-8c44-e125bb249de9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:02.871610 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-56aeae72-9d88-4b20-8c44-e125bb249de9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:02.872092 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-56aeae72-9d88-4b20-8c44-e125bb249de9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:02.872528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-56aeae72-9d88-4b20-8c44-e125bb249de9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:02.873210 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-56aeae72-9d88-4b20-8c44-e125bb249de9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:02.873658 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-56aeae72-9d88-4b20-8c44-e125bb249de9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:02.874078 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-56aeae72-9d88-4b20-8c44-e125bb249de9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:03.017924 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-56aeae72-9d88-4b20-8c44-e125bb249de9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:03.025936 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-56aeae72-9d88-4b20-8c44-e125bb249de9 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1756 microversion: 2.1 time: 0.166551 Sep 09 13:01:03.026517 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 257/509] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:02 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:04.049353 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-621bdcba-1b7d-443c-826b-1637760c28b1 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:04.049905 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-621bdcba-1b7d-443c-826b-1637760c28b1 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:04.056360 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-621bdcba-1b7d-443c-826b-1637760c28b1 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:04.056851 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-621bdcba-1b7d-443c-826b-1637760c28b1 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:04.057296 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-621bdcba-1b7d-443c-826b-1637760c28b1 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:04.057989 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-621bdcba-1b7d-443c-826b-1637760c28b1 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:04.058471 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-621bdcba-1b7d-443c-826b-1637760c28b1 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:04.058925 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-621bdcba-1b7d-443c-826b-1637760c28b1 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:04.206050 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-621bdcba-1b7d-443c-826b-1637760c28b1 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:04.214434 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-621bdcba-1b7d-443c-826b-1637760c28b1 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1756 microversion: 2.1 time: 0.169073 Sep 09 13:01:04.215026 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 253/510] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:04 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:04.328284 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-b5d753a6-0b0b-4028-82a9-f76dcb73e8fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:01:04.331288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-b5d753a6-0b0b-4028-82a9-f76dcb73e8fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:04.333624 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:01:04.338367 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b5d753a6-0b0b-4028-82a9-f76dcb73e8fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:04.338881 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b5d753a6-0b0b-4028-82a9-f76dcb73e8fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:04.339314 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b5d753a6-0b0b-4028-82a9-f76dcb73e8fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:04.340011 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b5d753a6-0b0b-4028-82a9-f76dcb73e8fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:04.340467 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b5d753a6-0b0b-4028-82a9-f76dcb73e8fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:04.340886 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b5d753a6-0b0b-4028-82a9-f76dcb73e8fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:04.365215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.objects.instance [None req-b5d753a6-0b0b-4028-82a9-f76dcb73e8fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lazy-loading 'flavor' on Instance uuid 54af832e-58c7-4e8c-9faf-318c9b33d2d7 {{(pid=127772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:01:04.609288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-b5d753a6-0b0b-4028-82a9-f76dcb73e8fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "POST /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/action" status: 200 len: 32 microversion: 2.1 time: 0.284968 Sep 09 13:01:04.609912 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 258/511] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 13:01:04 2022] POST /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/action => generated 32 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 13:01:04.620367 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2c12801a-d649-487e-af5a-54af61d5a51b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:04.621077 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2c12801a-d649-487e-af5a-54af61d5a51b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:04.626838 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2c12801a-d649-487e-af5a-54af61d5a51b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:04.627304 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2c12801a-d649-487e-af5a-54af61d5a51b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:04.627736 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2c12801a-d649-487e-af5a-54af61d5a51b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:04.628422 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2c12801a-d649-487e-af5a-54af61d5a51b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:04.628869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2c12801a-d649-487e-af5a-54af61d5a51b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:04.629293 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2c12801a-d649-487e-af5a-54af61d5a51b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:04.763203 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2c12801a-d649-487e-af5a-54af61d5a51b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:04.771444 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2c12801a-d649-487e-af5a-54af61d5a51b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1734 microversion: 2.1 time: 0.155043 Sep 09 13:01:04.772337 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 254/512] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:04 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:01:05.237978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-de2f87ff-20bf-458c-a9a8-dd1d089e40b2 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:05.238727 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-de2f87ff-20bf-458c-a9a8-dd1d089e40b2 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:05.245083 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-de2f87ff-20bf-458c-a9a8-dd1d089e40b2 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:05.245568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-de2f87ff-20bf-458c-a9a8-dd1d089e40b2 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:05.246010 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-de2f87ff-20bf-458c-a9a8-dd1d089e40b2 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:05.246734 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-de2f87ff-20bf-458c-a9a8-dd1d089e40b2 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:05.247192 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-de2f87ff-20bf-458c-a9a8-dd1d089e40b2 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:05.250784 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-de2f87ff-20bf-458c-a9a8-dd1d089e40b2 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:05.395518 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-de2f87ff-20bf-458c-a9a8-dd1d089e40b2 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:05.403921 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-de2f87ff-20bf-458c-a9a8-dd1d089e40b2 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1756 microversion: 2.1 time: 0.170452 Sep 09 13:01:05.404481 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 259/513] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:05 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:05.795176 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2ae1d2e1-0179-4f18-a0c8-2b4399e5d180 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:05.795786 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2ae1d2e1-0179-4f18-a0c8-2b4399e5d180 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:05.802837 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ae1d2e1-0179-4f18-a0c8-2b4399e5d180 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:05.803325 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ae1d2e1-0179-4f18-a0c8-2b4399e5d180 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:05.803757 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ae1d2e1-0179-4f18-a0c8-2b4399e5d180 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:05.804438 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ae1d2e1-0179-4f18-a0c8-2b4399e5d180 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:05.804887 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ae1d2e1-0179-4f18-a0c8-2b4399e5d180 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:05.805341 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ae1d2e1-0179-4f18-a0c8-2b4399e5d180 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:05.937302 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2ae1d2e1-0179-4f18-a0c8-2b4399e5d180 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:05.950070 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2ae1d2e1-0179-4f18-a0c8-2b4399e5d180 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1734 microversion: 2.1 time: 0.158696 Sep 09 13:01:05.950670 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 255/514] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:05 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:06.427776 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-f5dec14d-03dd-4ace-8e9c-3b7554733ac3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:06.428322 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-f5dec14d-03dd-4ace-8e9c-3b7554733ac3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:06.435834 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f5dec14d-03dd-4ace-8e9c-3b7554733ac3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:06.436314 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f5dec14d-03dd-4ace-8e9c-3b7554733ac3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:06.436743 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f5dec14d-03dd-4ace-8e9c-3b7554733ac3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:06.437479 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f5dec14d-03dd-4ace-8e9c-3b7554733ac3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:06.437927 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f5dec14d-03dd-4ace-8e9c-3b7554733ac3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:06.438434 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f5dec14d-03dd-4ace-8e9c-3b7554733ac3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:06.585239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-f5dec14d-03dd-4ace-8e9c-3b7554733ac3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:06.593677 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-f5dec14d-03dd-4ace-8e9c-3b7554733ac3 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1759 microversion: 2.1 time: 0.170754 Sep 09 13:01:06.594247 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 260/515] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:06 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:06.973454 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-1351b63f-c21d-47cc-ab4c-ae9c88d06aac tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:06.974091 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-1351b63f-c21d-47cc-ab4c-ae9c88d06aac tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:06.980463 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1351b63f-c21d-47cc-ab4c-ae9c88d06aac tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:06.980961 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1351b63f-c21d-47cc-ab4c-ae9c88d06aac tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:06.981379 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1351b63f-c21d-47cc-ab4c-ae9c88d06aac tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:06.982055 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1351b63f-c21d-47cc-ab4c-ae9c88d06aac tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:06.982555 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1351b63f-c21d-47cc-ab4c-ae9c88d06aac tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:06.982975 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1351b63f-c21d-47cc-ab4c-ae9c88d06aac tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:07.109537 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-1351b63f-c21d-47cc-ab4c-ae9c88d06aac tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:07.117698 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-1351b63f-c21d-47cc-ab4c-ae9c88d06aac tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1734 microversion: 2.1 time: 0.148050 Sep 09 13:01:07.118261 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 256/516] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:06 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:07.317649 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-3d9df275-f43f-4ddd-967a-8822126e6d7c tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:07.318069 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-3d9df275-f43f-4ddd-967a-8822126e6d7c tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:07.324040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3d9df275-f43f-4ddd-967a-8822126e6d7c tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:07.324514 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3d9df275-f43f-4ddd-967a-8822126e6d7c tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:07.324944 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3d9df275-f43f-4ddd-967a-8822126e6d7c tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:07.325619 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3d9df275-f43f-4ddd-967a-8822126e6d7c tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:07.326066 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3d9df275-f43f-4ddd-967a-8822126e6d7c tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:07.326508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3d9df275-f43f-4ddd-967a-8822126e6d7c tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:07.349261 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-3d9df275-f43f-4ddd-967a-8822126e6d7c tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e/ips" status: 200 len: 151 microversion: 2.1 time: 0.036309 Sep 09 13:01:07.349816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 261/517] 10.222.0.46 () {58 vars in 1248 bytes} [Fri Sep 9 13:01:07 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:01:08.141158 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-88301bb6-91fb-43ac-87f8-81321a1382b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:08.141813 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-88301bb6-91fb-43ac-87f8-81321a1382b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:08.148817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-88301bb6-91fb-43ac-87f8-81321a1382b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:08.149299 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-88301bb6-91fb-43ac-87f8-81321a1382b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:08.149734 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-88301bb6-91fb-43ac-87f8-81321a1382b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:08.150419 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-88301bb6-91fb-43ac-87f8-81321a1382b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:08.150897 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-88301bb6-91fb-43ac-87f8-81321a1382b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:08.151321 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-88301bb6-91fb-43ac-87f8-81321a1382b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:08.167128 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=100 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:01:08.288295 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-88301bb6-91fb-43ac-87f8-81321a1382b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:08.296807 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-88301bb6-91fb-43ac-87f8-81321a1382b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1734 microversion: 2.1 time: 0.159483 Sep 09 13:01:08.297370 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 257/518] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:08 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:08.990879 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-75ee959c-6b08-48fe-97ee-faa05c137761 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e5c7bb3-5f96-41e5-bb53-22a2bae83db6"}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:01:08.993248 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-75ee959c-6b08-48fe-97ee-faa05c137761 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:08.999714 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-75ee959c-6b08-48fe-97ee-faa05c137761 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:09.000199 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-75ee959c-6b08-48fe-97ee-faa05c137761 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:09.000647 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-75ee959c-6b08-48fe-97ee-faa05c137761 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:09.001339 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-75ee959c-6b08-48fe-97ee-faa05c137761 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:09.002440 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-75ee959c-6b08-48fe-97ee-faa05c137761 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:09.002908 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-75ee959c-6b08-48fe-97ee-faa05c137761 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:09.319779 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-c60e8859-3751-4b10-bfb5-7acd52c6ed19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:09.320399 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-c60e8859-3751-4b10-bfb5-7acd52c6ed19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:09.326987 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c60e8859-3751-4b10-bfb5-7acd52c6ed19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:09.327479 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c60e8859-3751-4b10-bfb5-7acd52c6ed19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:09.327922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c60e8859-3751-4b10-bfb5-7acd52c6ed19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:09.328769 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c60e8859-3751-4b10-bfb5-7acd52c6ed19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:09.329225 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c60e8859-3751-4b10-bfb5-7acd52c6ed19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:09.329688 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c60e8859-3751-4b10-bfb5-7acd52c6ed19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:09.458855 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-c60e8859-3751-4b10-bfb5-7acd52c6ed19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:09.467284 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-c60e8859-3751-4b10-bfb5-7acd52c6ed19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1734 microversion: 2.1 time: 0.151261 Sep 09 13:01:09.467854 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 258/519] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:09 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:01:09.708676 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-75ee959c-6b08-48fe-97ee-faa05c137761 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "POST /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.722178 Sep 09 13:01:09.709309 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 262/520] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 13:01:08 2022] POST /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e/os-volume_attachments => generated 194 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:01:10.492072 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8cea409f-9ced-4fc7-aa9d-3a3cf2c01f87 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:10.492680 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-8cea409f-9ced-4fc7-aa9d-3a3cf2c01f87 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:10.499053 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8cea409f-9ced-4fc7-aa9d-3a3cf2c01f87 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:10.499533 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8cea409f-9ced-4fc7-aa9d-3a3cf2c01f87 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:10.499964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8cea409f-9ced-4fc7-aa9d-3a3cf2c01f87 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:10.500641 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8cea409f-9ced-4fc7-aa9d-3a3cf2c01f87 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:10.501090 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8cea409f-9ced-4fc7-aa9d-3a3cf2c01f87 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:10.501530 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8cea409f-9ced-4fc7-aa9d-3a3cf2c01f87 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:10.634153 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-8cea409f-9ced-4fc7-aa9d-3a3cf2c01f87 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:10.642352 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-8cea409f-9ced-4fc7-aa9d-3a3cf2c01f87 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1734 microversion: 2.1 time: 0.154075 Sep 09 13:01:10.642948 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 259/521] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:10 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:11.666235 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a1dee8f9-deff-4339-982f-e35eab07c36f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:11.666970 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a1dee8f9-deff-4339-982f-e35eab07c36f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:11.673042 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a1dee8f9-deff-4339-982f-e35eab07c36f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:11.673514 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a1dee8f9-deff-4339-982f-e35eab07c36f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:11.673943 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a1dee8f9-deff-4339-982f-e35eab07c36f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:11.674653 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a1dee8f9-deff-4339-982f-e35eab07c36f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:11.675100 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a1dee8f9-deff-4339-982f-e35eab07c36f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:11.675517 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a1dee8f9-deff-4339-982f-e35eab07c36f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:11.802859 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a1dee8f9-deff-4339-982f-e35eab07c36f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:11.811100 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a1dee8f9-deff-4339-982f-e35eab07c36f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1734 microversion: 2.1 time: 0.149525 Sep 09 13:01:11.811657 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 263/522] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:11 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:12.835467 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-f74aad40-5bf1-46d4-b372-bd1bc572dfc5 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:12.835999 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-f74aad40-5bf1-46d4-b372-bd1bc572dfc5 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:12.842340 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f74aad40-5bf1-46d4-b372-bd1bc572dfc5 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:12.842849 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f74aad40-5bf1-46d4-b372-bd1bc572dfc5 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:12.843284 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f74aad40-5bf1-46d4-b372-bd1bc572dfc5 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:12.843963 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f74aad40-5bf1-46d4-b372-bd1bc572dfc5 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:12.844410 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f74aad40-5bf1-46d4-b372-bd1bc572dfc5 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:12.844831 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f74aad40-5bf1-46d4-b372-bd1bc572dfc5 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:12.972760 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-f74aad40-5bf1-46d4-b372-bd1bc572dfc5 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:12.981119 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-f74aad40-5bf1-46d4-b372-bd1bc572dfc5 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1734 microversion: 2.1 time: 0.150255 Sep 09 13:01:12.981682 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 260/523] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:12 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:14.006644 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-d18f99cc-b090-4cee-be6b-f1497035ca19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:14.007292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-d18f99cc-b090-4cee-be6b-f1497035ca19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:14.013859 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d18f99cc-b090-4cee-be6b-f1497035ca19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:14.014345 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d18f99cc-b090-4cee-be6b-f1497035ca19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:14.014815 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d18f99cc-b090-4cee-be6b-f1497035ca19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:14.015528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d18f99cc-b090-4cee-be6b-f1497035ca19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:14.015982 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d18f99cc-b090-4cee-be6b-f1497035ca19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:14.016406 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d18f99cc-b090-4cee-be6b-f1497035ca19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:14.144641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-d18f99cc-b090-4cee-be6b-f1497035ca19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:14.152904 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-d18f99cc-b090-4cee-be6b-f1497035ca19 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1734 microversion: 2.1 time: 0.152092 Sep 09 13:01:14.153470 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 264/524] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:13 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:15.175848 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-f36effc9-b07d-4961-afac-c515bd2933fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:15.176519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-f36effc9-b07d-4961-afac-c515bd2933fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:15.184729 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f36effc9-b07d-4961-afac-c515bd2933fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:15.185207 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f36effc9-b07d-4961-afac-c515bd2933fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:15.185644 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f36effc9-b07d-4961-afac-c515bd2933fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:15.186331 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f36effc9-b07d-4961-afac-c515bd2933fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:15.186850 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f36effc9-b07d-4961-afac-c515bd2933fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:15.187530 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f36effc9-b07d-4961-afac-c515bd2933fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:15.322463 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-f36effc9-b07d-4961-afac-c515bd2933fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:15.330929 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-f36effc9-b07d-4961-afac-c515bd2933fe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1734 microversion: 2.1 time: 0.158944 Sep 09 13:01:15.331491 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 261/525] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:15 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:16.355580 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ed6004a8-c5a9-457c-aab9-068791294db0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:16.356132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-ed6004a8-c5a9-457c-aab9-068791294db0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:16.363040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ed6004a8-c5a9-457c-aab9-068791294db0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:16.363522 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ed6004a8-c5a9-457c-aab9-068791294db0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:16.363955 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ed6004a8-c5a9-457c-aab9-068791294db0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:16.365289 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ed6004a8-c5a9-457c-aab9-068791294db0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:16.366113 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ed6004a8-c5a9-457c-aab9-068791294db0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:16.366567 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ed6004a8-c5a9-457c-aab9-068791294db0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:16.501894 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ed6004a8-c5a9-457c-aab9-068791294db0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:16.510760 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-ed6004a8-c5a9-457c-aab9-068791294db0 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1734 microversion: 2.1 time: 0.159404 Sep 09 13:01:16.511543 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 265/526] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:16 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:17.250634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-6b395091-18f7-455e-bf07-c3f925143b7e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e5c7bb3-5f96-41e5-bb53-22a2bae83db6"}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:01:17.253076 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-6b395091-18f7-455e-bf07-c3f925143b7e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:17.259767 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6b395091-18f7-455e-bf07-c3f925143b7e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:17.260247 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6b395091-18f7-455e-bf07-c3f925143b7e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:17.260679 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6b395091-18f7-455e-bf07-c3f925143b7e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:17.261362 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6b395091-18f7-455e-bf07-c3f925143b7e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:17.261814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6b395091-18f7-455e-bf07-c3f925143b7e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:17.262236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6b395091-18f7-455e-bf07-c3f925143b7e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:17.340462 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-6b395091-18f7-455e-bf07-c3f925143b7e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] HTTP exception thrown: Invalid volume: volume 9e5c7bb3-5f96-41e5-bb53-22a2bae83db6 is already attached to instances: cfc21374-47be-4788-8ba9-e2f77ae73d6e Sep 09 13:01:17.342195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-6b395091-18f7-455e-bf07-c3f925143b7e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Request method failure captured: Sep 09 13:01:17.342195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: POST /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e/os-volume_attachments HTTP/1.1 Sep 09 13:01:17.342195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:01:17.342195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:01:17.342195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:01:17.342195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 74 Sep 09 13:01:17.342195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:01:17.342195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:01:17.342195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:01:17.342195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:01:17.342195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzgEaKb6PZCqo9yxUSEJiFD1xb1LGODlWVgID9cA22eqBLNomTmu2q0yMgjccpW69nnUAUWKXMpFaG8X-sF87AhuIdLNOF9PvF4tjoZWf7SNwd1H5TWSvp_IUIt9lOp_NKX-JRPFLgnDrNAvr9jG5GRaXTb0sVN8rNo6hRRXay_HW10 Sep 09 13:01:17.342195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:01:17.342195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:01:17.342195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:01:17.342195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:01:17.342195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:01:17.342195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:01:17.342195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:01:17.342195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:01:17.342195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:01:17.342195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:01:17.343788 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ceed6a1f0f4542cbafa4b2a46b16d5fb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}] Sep 09 13:01:17.343788 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:01:17.343788 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:01:17.343788 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:01:17.343788 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:01:17.343788 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:01:17.343788 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:01:17.343788 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 63a2902f465f4fd1aed80060c2669259 Sep 09 13:01:17.343788 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:01:17.343788 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Sep 09 13:01:17.343788 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {"volumeAttachment": {"volumeId": "9e5c7bb3-5f96-41e5-bb53-22a2bae83db6"}} Sep 09 13:01:17.343788 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:01:17.344651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Invalid volume: volume 9e5c7bb3-5f96-41e5-bb53-22a2bae83db6 is already attached to instances: cfc21374-47be-4788-8ba9-e2f77ae73d6e Sep 09 13:01:17.344651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'server_id': 'cfc21374-47be-4788-8ba9-e2f77ae73d6e', 'body': {'volumeAttachment': {'volumeId': '9e5c7bb3-5f96-41e5-bb53-22a2bae83db6'}}} Sep 09 13:01:17.344651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:01:17.344651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:01:17.344651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 13:01:17.344651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 13:01:17.344651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 13:01:17.344651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 13:01:17.344651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 13:01:17.344651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 13:01:17.344651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 13:01:17.344651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 13:01:17.344651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 13:01:17.344651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 13:01:17.344651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9e5c7bb3-5f96-41e5-bb53-22a2bae83db6 is already attached to instances: cfc21374-47be-4788-8ba9-e2f77ae73d6e Sep 09 13:01:17.344651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:01:17.344651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:01:17.344651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:01:17.344651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:01:17.346100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:01:17.346100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:01:17.346100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:01:17.346100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:01:17.346100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:01:17.346100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:01:17.346100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 13:01:17.346100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 13:01:17.346100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 13:01:17.346100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 13:01:17.346100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 13:01:17.346100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 13:01:17.346100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 13:01:17.346100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 13:01:17.346100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9e5c7bb3-5f96-41e5-bb53-22a2bae83db6 is already attached to instances: cfc21374-47be-4788-8ba9-e2f77ae73d6e Sep 09 13:01:17.346100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:01:17.346100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:01:17.346100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:01:17.346100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:01:17.346100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:01:17.347546 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:01:17.347546 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:01:17.347546 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:01:17.347546 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9e5c7bb3-5f96-41e5-bb53-22a2bae83db6 is already attached to instances: cfc21374-47be-4788-8ba9-e2f77ae73d6e Sep 09 13:01:17.347546 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:01:17.347546 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-6b395091-18f7-455e-bf07-c3f925143b7e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Returning 400 to user: Invalid volume: volume 9e5c7bb3-5f96-41e5-bb53-22a2bae83db6 is already attached to instances: cfc21374-47be-4788-8ba9-e2f77ae73d6e {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:01:17.347546 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-6b395091-18f7-455e-bf07-c3f925143b7e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "POST /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097041 Sep 09 13:01:17.347546 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 262/527] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 13:01:17 2022] POST /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 13:01:17.410211 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-0a277b06-0044-43d7-bcb0-70b9a0d0cc93 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:17.410752 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-0a277b06-0044-43d7-bcb0-70b9a0d0cc93 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:17.417841 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0a277b06-0044-43d7-bcb0-70b9a0d0cc93 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:17.418322 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0a277b06-0044-43d7-bcb0-70b9a0d0cc93 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:17.418781 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0a277b06-0044-43d7-bcb0-70b9a0d0cc93 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:17.419485 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0a277b06-0044-43d7-bcb0-70b9a0d0cc93 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:17.419932 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0a277b06-0044-43d7-bcb0-70b9a0d0cc93 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:17.420352 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0a277b06-0044-43d7-bcb0-70b9a0d0cc93 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:17.504113 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.objects.instance [None req-0a277b06-0044-43d7-bcb0-70b9a0d0cc93 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lazy-loading 'services' on Instance uuid cfc21374-47be-4788-8ba9-e2f77ae73d6e {{(pid=127772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:01:17.532879 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ef9cc10d-02d7-4464-9dff-646318c34605 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:17.533497 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ef9cc10d-02d7-4464-9dff-646318c34605 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:17.541225 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ef9cc10d-02d7-4464-9dff-646318c34605 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:17.541711 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ef9cc10d-02d7-4464-9dff-646318c34605 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:17.542149 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ef9cc10d-02d7-4464-9dff-646318c34605 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:17.542874 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ef9cc10d-02d7-4464-9dff-646318c34605 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:17.543330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ef9cc10d-02d7-4464-9dff-646318c34605 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:17.543757 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ef9cc10d-02d7-4464-9dff-646318c34605 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:17.675599 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ef9cc10d-02d7-4464-9dff-646318c34605 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:17.684534 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ef9cc10d-02d7-4464-9dff-646318c34605 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1734 microversion: 2.1 time: 0.155421 Sep 09 13:01:17.685450 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 263/528] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:17 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:01:17.709480 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-0a277b06-0044-43d7-bcb0-70b9a0d0cc93 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e/os-volume_attachments/9e5c7bb3-5f96-41e5-bb53-22a2bae83db6" status: 202 len: 0 microversion: 2.1 time: 0.302993 Sep 09 13:01:17.710222 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 266/529] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 13:01:17 2022] DELETE /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e/os-volume_attachments/9e5c7bb3-5f96-41e5-bb53-22a2bae83db6 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:01:17.718543 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-5a0411ba-a240-41c0-86d4-8588f4410b6f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:17.720852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-5a0411ba-a240-41c0-86d4-8588f4410b6f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:17.727700 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a0411ba-a240-41c0-86d4-8588f4410b6f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:17.728208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a0411ba-a240-41c0-86d4-8588f4410b6f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:17.728653 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a0411ba-a240-41c0-86d4-8588f4410b6f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:17.729363 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a0411ba-a240-41c0-86d4-8588f4410b6f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:17.729824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a0411ba-a240-41c0-86d4-8588f4410b6f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:17.730285 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a0411ba-a240-41c0-86d4-8588f4410b6f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:17.767001 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-5a0411ba-a240-41c0-86d4-8588f4410b6f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052377 Sep 09 13:01:17.767556 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 264/530] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:01:17 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:01:18.709490 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-1656764e-6d2f-4fd8-9650-4c490eb7d41a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:18.710154 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-1656764e-6d2f-4fd8-9650-4c490eb7d41a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:18.716714 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1656764e-6d2f-4fd8-9650-4c490eb7d41a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:18.717224 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1656764e-6d2f-4fd8-9650-4c490eb7d41a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:18.717654 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1656764e-6d2f-4fd8-9650-4c490eb7d41a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:18.718339 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1656764e-6d2f-4fd8-9650-4c490eb7d41a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:18.718818 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1656764e-6d2f-4fd8-9650-4c490eb7d41a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:18.719244 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1656764e-6d2f-4fd8-9650-4c490eb7d41a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:18.779970 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0da37e8e-e090-41f9-9e86-f31d8c3520ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:18.782769 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-0da37e8e-e090-41f9-9e86-f31d8c3520ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:18.790155 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0da37e8e-e090-41f9-9e86-f31d8c3520ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:18.790921 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0da37e8e-e090-41f9-9e86-f31d8c3520ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:18.791358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0da37e8e-e090-41f9-9e86-f31d8c3520ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:18.792049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0da37e8e-e090-41f9-9e86-f31d8c3520ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:18.792502 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0da37e8e-e090-41f9-9e86-f31d8c3520ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:18.792926 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0da37e8e-e090-41f9-9e86-f31d8c3520ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:18.824275 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0da37e8e-e090-41f9-9e86-f31d8c3520ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048689 Sep 09 13:01:18.825024 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 265/531] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:01:18 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:01:18.857359 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-1656764e-6d2f-4fd8-9650-4c490eb7d41a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:18.866298 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-1656764e-6d2f-4fd8-9650-4c490eb7d41a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1734 microversion: 2.1 time: 0.161457 Sep 09 13:01:18.866936 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 267/532] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:18 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:19.837682 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-b69d4135-4779-4e5a-8d8f-75ae51a00f4e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:19.840004 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-b69d4135-4779-4e5a-8d8f-75ae51a00f4e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:19.846439 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b69d4135-4779-4e5a-8d8f-75ae51a00f4e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:19.846953 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b69d4135-4779-4e5a-8d8f-75ae51a00f4e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:19.847393 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b69d4135-4779-4e5a-8d8f-75ae51a00f4e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:19.848077 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b69d4135-4779-4e5a-8d8f-75ae51a00f4e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:19.848528 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b69d4135-4779-4e5a-8d8f-75ae51a00f4e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:19.849665 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b69d4135-4779-4e5a-8d8f-75ae51a00f4e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:19.879124 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-b69d4135-4779-4e5a-8d8f-75ae51a00f4e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046560 Sep 09 13:01:19.879668 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 266/533] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:01:19 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 13:01:19.889181 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-f43df2fc-e395-4eb3-807e-faea71fd6d1a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:19.889856 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-f43df2fc-e395-4eb3-807e-faea71fd6d1a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:19.896384 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f43df2fc-e395-4eb3-807e-faea71fd6d1a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:19.896870 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f43df2fc-e395-4eb3-807e-faea71fd6d1a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:19.897298 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f43df2fc-e395-4eb3-807e-faea71fd6d1a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:19.897989 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f43df2fc-e395-4eb3-807e-faea71fd6d1a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:19.898436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f43df2fc-e395-4eb3-807e-faea71fd6d1a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:19.898885 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f43df2fc-e395-4eb3-807e-faea71fd6d1a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:19.945287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-97c586bb-4dae-491b-a154-19e79d899bb8 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:19.945784 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-97c586bb-4dae-491b-a154-19e79d899bb8 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:19.951911 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-97c586bb-4dae-491b-a154-19e79d899bb8 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:19.952396 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-97c586bb-4dae-491b-a154-19e79d899bb8 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:19.952833 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-97c586bb-4dae-491b-a154-19e79d899bb8 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:19.953522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-97c586bb-4dae-491b-a154-19e79d899bb8 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:19.953976 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-97c586bb-4dae-491b-a154-19e79d899bb8 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:19.954400 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-97c586bb-4dae-491b-a154-19e79d899bb8 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:19.979831 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-97c586bb-4dae-491b-a154-19e79d899bb8 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Going to try to terminate instance {{(pid=127771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:01:20.264757 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-f43df2fc-e395-4eb3-807e-faea71fd6d1a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:20.273639 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-f43df2fc-e395-4eb3-807e-faea71fd6d1a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1734 microversion: 2.1 time: 0.388429 Sep 09 13:01:20.274207 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 268/534] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:19 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1734 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:20.291471 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-97c586bb-4dae-491b-a154-19e79d899bb8 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e" status: 204 len: 0 microversion: 2.1 time: 0.350817 Sep 09 13:01:20.292042 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 267/535] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:01:19 2022] DELETE /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 13:01:20.299701 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-6f45f7d5-aa3d-4c23-9f10-c013e166040f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:20.300338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-6f45f7d5-aa3d-4c23-9f10-c013e166040f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:20.307274 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6f45f7d5-aa3d-4c23-9f10-c013e166040f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:20.307757 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6f45f7d5-aa3d-4c23-9f10-c013e166040f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:20.308189 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6f45f7d5-aa3d-4c23-9f10-c013e166040f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:20.308877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6f45f7d5-aa3d-4c23-9f10-c013e166040f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:20.309327 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6f45f7d5-aa3d-4c23-9f10-c013e166040f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:20.309776 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6f45f7d5-aa3d-4c23-9f10-c013e166040f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:20.442512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-6f45f7d5-aa3d-4c23-9f10-c013e166040f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:20.446059 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:01:20.450596 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-6f45f7d5-aa3d-4c23-9f10-c013e166040f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e" status: 200 len: 1682 microversion: 2.1 time: 0.154488 Sep 09 13:01:20.451181 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 269/536] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:20 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:21.298240 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-4d631176-89a8-4c49-8fca-0514fc35287c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:21.298974 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-4d631176-89a8-4c49-8fca-0514fc35287c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:21.305468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4d631176-89a8-4c49-8fca-0514fc35287c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:21.305948 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4d631176-89a8-4c49-8fca-0514fc35287c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:21.306385 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4d631176-89a8-4c49-8fca-0514fc35287c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:21.307108 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4d631176-89a8-4c49-8fca-0514fc35287c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:21.307561 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4d631176-89a8-4c49-8fca-0514fc35287c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:21.307982 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4d631176-89a8-4c49-8fca-0514fc35287c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:21.439100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-4d631176-89a8-4c49-8fca-0514fc35287c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:21.448163 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-4d631176-89a8-4c49-8fca-0514fc35287c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1734 microversion: 2.1 time: 0.154227 Sep 09 13:01:21.448723 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 268/537] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:21 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:21.473041 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-00e4a14f-4762-4303-ada2-22fc77f6073f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:21.473648 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-00e4a14f-4762-4303-ada2-22fc77f6073f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:21.480837 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-00e4a14f-4762-4303-ada2-22fc77f6073f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:21.481319 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-00e4a14f-4762-4303-ada2-22fc77f6073f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:21.481749 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-00e4a14f-4762-4303-ada2-22fc77f6073f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:21.482433 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-00e4a14f-4762-4303-ada2-22fc77f6073f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:21.482904 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-00e4a14f-4762-4303-ada2-22fc77f6073f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:21.483325 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-00e4a14f-4762-4303-ada2-22fc77f6073f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:21.619478 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-00e4a14f-4762-4303-ada2-22fc77f6073f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:21.627170 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-00e4a14f-4762-4303-ada2-22fc77f6073f tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e" status: 200 len: 1682 microversion: 2.1 time: 0.157939 Sep 09 13:01:21.627668 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 270/538] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:21 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:22.470932 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-b67f3026-66f0-48b7-9b2b-7eff77b42c98 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:22.471553 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-b67f3026-66f0-48b7-9b2b-7eff77b42c98 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:22.478642 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b67f3026-66f0-48b7-9b2b-7eff77b42c98 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:22.479135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b67f3026-66f0-48b7-9b2b-7eff77b42c98 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:22.479577 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b67f3026-66f0-48b7-9b2b-7eff77b42c98 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:22.480275 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b67f3026-66f0-48b7-9b2b-7eff77b42c98 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:22.480751 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b67f3026-66f0-48b7-9b2b-7eff77b42c98 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:22.481164 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b67f3026-66f0-48b7-9b2b-7eff77b42c98 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:22.609835 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-b67f3026-66f0-48b7-9b2b-7eff77b42c98 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:22.618364 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-b67f3026-66f0-48b7-9b2b-7eff77b42c98 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1734 microversion: 2.1 time: 0.151291 Sep 09 13:01:22.618961 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 269/539] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:22 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:22.650511 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a7049a3d-8188-418c-a983-5accc89471fb tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:22.651143 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a7049a3d-8188-418c-a983-5accc89471fb tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:22.657475 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a7049a3d-8188-418c-a983-5accc89471fb tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:22.657950 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a7049a3d-8188-418c-a983-5accc89471fb tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:22.658383 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a7049a3d-8188-418c-a983-5accc89471fb tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:22.659095 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a7049a3d-8188-418c-a983-5accc89471fb tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:22.659547 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a7049a3d-8188-418c-a983-5accc89471fb tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:22.659967 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a7049a3d-8188-418c-a983-5accc89471fb tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:22.785094 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a7049a3d-8188-418c-a983-5accc89471fb tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:22.793046 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a7049a3d-8188-418c-a983-5accc89471fb tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e" status: 200 len: 1682 microversion: 2.1 time: 0.147220 Sep 09 13:01:22.793604 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 271/540] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:22 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:23.641661 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-7bb2ea2e-517c-43e7-a3b5-567b42ed7a20 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:23.642270 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-7bb2ea2e-517c-43e7-a3b5-567b42ed7a20 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:23.644768 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:01:23.649573 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7bb2ea2e-517c-43e7-a3b5-567b42ed7a20 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:23.657129 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7bb2ea2e-517c-43e7-a3b5-567b42ed7a20 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:23.657129 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7bb2ea2e-517c-43e7-a3b5-567b42ed7a20 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:23.657129 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7bb2ea2e-517c-43e7-a3b5-567b42ed7a20 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:23.657129 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7bb2ea2e-517c-43e7-a3b5-567b42ed7a20 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:23.657473 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7bb2ea2e-517c-43e7-a3b5-567b42ed7a20 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:23.781454 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-7bb2ea2e-517c-43e7-a3b5-567b42ed7a20 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:23.790033 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-7bb2ea2e-517c-43e7-a3b5-567b42ed7a20 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1734 microversion: 2.1 time: 0.152192 Sep 09 13:01:23.790626 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 270/541] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:23 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:23.815708 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-283914f0-78a1-4d5a-9eec-1d199cd95263 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:23.816320 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-283914f0-78a1-4d5a-9eec-1d199cd95263 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:23.822834 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-283914f0-78a1-4d5a-9eec-1d199cd95263 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:23.823316 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-283914f0-78a1-4d5a-9eec-1d199cd95263 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:23.823749 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-283914f0-78a1-4d5a-9eec-1d199cd95263 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:23.824435 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-283914f0-78a1-4d5a-9eec-1d199cd95263 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:23.824886 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-283914f0-78a1-4d5a-9eec-1d199cd95263 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:23.825307 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-283914f0-78a1-4d5a-9eec-1d199cd95263 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:24.034453 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-283914f0-78a1-4d5a-9eec-1d199cd95263 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:24.042771 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-283914f0-78a1-4d5a-9eec-1d199cd95263 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e" status: 200 len: 1682 microversion: 2.1 time: 0.230860 Sep 09 13:01:24.043360 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 272/542] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:23 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e => generated 1682 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:24.455791 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-01772ccc-adc8-4d86-82f0-b3d9db4fea7a req-274fb9e9-6e89-4868-8932-c532bb81fada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfc21374-47be-4788-8ba9-e2f77ae73d6e", "name": "network-vif-deleted", "tag": "f11c548b-432c-4945-bede-1e36e6933ffa"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:01:24.465361 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-01772ccc-adc8-4d86-82f0-b3d9db4fea7a req-274fb9e9-6e89-4868-8932-c532bb81fada service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:24.465845 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-01772ccc-adc8-4d86-82f0-b3d9db4fea7a req-274fb9e9-6e89-4868-8932-c532bb81fada service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:24.466275 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-01772ccc-adc8-4d86-82f0-b3d9db4fea7a req-274fb9e9-6e89-4868-8932-c532bb81fada service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:24.478607 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-01772ccc-adc8-4d86-82f0-b3d9db4fea7a req-274fb9e9-6e89-4868-8932-c532bb81fada service nova] Creating event network-vif-deleted:f11c548b-432c-4945-bede-1e36e6933ffa for instance cfc21374-47be-4788-8ba9-e2f77ae73d6e on hv-cinder-81322 Sep 09 13:01:24.484040 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-01772ccc-adc8-4d86-82f0-b3d9db4fea7a req-274fb9e9-6e89-4868-8932-c532bb81fada service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032171 Sep 09 13:01:24.484627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 271/543] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:01:24.813308 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7150a7b0-d2ea-4282-a5e4-6a8094c20ce3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:24.813821 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7150a7b0-d2ea-4282-a5e4-6a8094c20ce3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:24.820974 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7150a7b0-d2ea-4282-a5e4-6a8094c20ce3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:24.821561 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7150a7b0-d2ea-4282-a5e4-6a8094c20ce3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:24.821883 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7150a7b0-d2ea-4282-a5e4-6a8094c20ce3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:24.822607 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7150a7b0-d2ea-4282-a5e4-6a8094c20ce3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:24.823085 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7150a7b0-d2ea-4282-a5e4-6a8094c20ce3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:24.823490 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7150a7b0-d2ea-4282-a5e4-6a8094c20ce3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:24.857306 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d45edc67-56b0-4dfa-9998-22251ba4240d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:24.858568 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-d45edc67-56b0-4dfa-9998-22251ba4240d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:24.865547 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d45edc67-56b0-4dfa-9998-22251ba4240d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:24.866131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d45edc67-56b0-4dfa-9998-22251ba4240d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:24.866630 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d45edc67-56b0-4dfa-9998-22251ba4240d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:24.867337 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d45edc67-56b0-4dfa-9998-22251ba4240d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:24.867792 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d45edc67-56b0-4dfa-9998-22251ba4240d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:24.868326 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d45edc67-56b0-4dfa-9998-22251ba4240d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:24.896398 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d45edc67-56b0-4dfa-9998-22251ba4240d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775/ips" status: 200 len: 151 microversion: 2.20 time: 0.043803 Sep 09 13:01:24.897336 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 272/544] 10.222.0.46 () {60 vars in 1289 bytes} [Fri Sep 9 13:01:24 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:01:24.968398 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7150a7b0-d2ea-4282-a5e4-6a8094c20ce3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:24.975251 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7150a7b0-d2ea-4282-a5e4-6a8094c20ce3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1734 microversion: 2.1 time: 0.165772 Sep 09 13:01:24.975878 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 273/545] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:24 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:25.069229 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e59fdd9b-fd62-42cf-b3dc-f3bec3757b0e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:25.069747 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-e59fdd9b-fd62-42cf-b3dc-f3bec3757b0e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:25.075782 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e59fdd9b-fd62-42cf-b3dc-f3bec3757b0e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:25.076267 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e59fdd9b-fd62-42cf-b3dc-f3bec3757b0e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:25.076705 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e59fdd9b-fd62-42cf-b3dc-f3bec3757b0e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:25.077392 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e59fdd9b-fd62-42cf-b3dc-f3bec3757b0e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:25.077842 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e59fdd9b-fd62-42cf-b3dc-f3bec3757b0e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:25.078341 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e59fdd9b-fd62-42cf-b3dc-f3bec3757b0e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:25.094286 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:01:25.112133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e59fdd9b-fd62-42cf-b3dc-f3bec3757b0e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:25.112612 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e59fdd9b-fd62-42cf-b3dc-f3bec3757b0e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:25.113048 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e59fdd9b-fd62-42cf-b3dc-f3bec3757b0e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:25.113501 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.objects.instance [None req-e59fdd9b-fd62-42cf-b3dc-f3bec3757b0e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lazy-loading 'fault' on Instance uuid cfc21374-47be-4788-8ba9-e2f77ae73d6e {{(pid=127771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:01:25.277093 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e59fdd9b-fd62-42cf-b3dc-f3bec3757b0e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:25.287638 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-e59fdd9b-fd62-42cf-b3dc-f3bec3757b0e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e" status: 200 len: 1331 microversion: 2.1 time: 0.222918 Sep 09 13:01:25.288315 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 273/546] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:25 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e => generated 1331 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:25.998442 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-2f46486b-e466-4cd8-adfe-ef72116b4d62 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:25.999093 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-2f46486b-e466-4cd8-adfe-ef72116b4d62 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:26.005327 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2f46486b-e466-4cd8-adfe-ef72116b4d62 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:26.006002 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2f46486b-e466-4cd8-adfe-ef72116b4d62 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:26.006436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2f46486b-e466-4cd8-adfe-ef72116b4d62 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:26.007149 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2f46486b-e466-4cd8-adfe-ef72116b4d62 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:26.007596 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2f46486b-e466-4cd8-adfe-ef72116b4d62 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:26.008016 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2f46486b-e466-4cd8-adfe-ef72116b4d62 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:26.196288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-2f46486b-e466-4cd8-adfe-ef72116b4d62 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:26.204618 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-2f46486b-e466-4cd8-adfe-ef72116b4d62 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1714 microversion: 2.1 time: 0.209973 Sep 09 13:01:26.205507 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 274/547] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:25 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1714 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:26.270296 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-845289b4-1f92-4b3f-8f67-029365c20425 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:26.270296 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-845289b4-1f92-4b3f-8f67-029365c20425 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:26.275640 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-845289b4-1f92-4b3f-8f67-029365c20425 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:26.276126 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-845289b4-1f92-4b3f-8f67-029365c20425 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:26.276572 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-845289b4-1f92-4b3f-8f67-029365c20425 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:26.277266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-845289b4-1f92-4b3f-8f67-029365c20425 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:26.277746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-845289b4-1f92-4b3f-8f67-029365c20425 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:26.278184 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-845289b4-1f92-4b3f-8f67-029365c20425 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:26.311847 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ce87f723-2b81-4296-9735-93b285e46f63 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:26.312452 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-ce87f723-2b81-4296-9735-93b285e46f63 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:26.321953 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ce87f723-2b81-4296-9735-93b285e46f63 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:26.321953 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ce87f723-2b81-4296-9735-93b285e46f63 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:26.321953 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ce87f723-2b81-4296-9735-93b285e46f63 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:26.321953 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ce87f723-2b81-4296-9735-93b285e46f63 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:26.322283 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ce87f723-2b81-4296-9735-93b285e46f63 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:26.322283 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ce87f723-2b81-4296-9735-93b285e46f63 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:26.357265 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ce87f723-2b81-4296-9735-93b285e46f63 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:26.357987 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ce87f723-2b81-4296-9735-93b285e46f63 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:26.358639 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ce87f723-2b81-4296-9735-93b285e46f63 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:26.359083 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.objects.instance [None req-ce87f723-2b81-4296-9735-93b285e46f63 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lazy-loading 'fault' on Instance uuid cfc21374-47be-4788-8ba9-e2f77ae73d6e {{(pid=127772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:01:26.407870 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ce87f723-2b81-4296-9735-93b285e46f63 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:26.416739 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-ce87f723-2b81-4296-9735-93b285e46f63 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e" status: 200 len: 1331 microversion: 2.1 time: 0.107826 Sep 09 13:01:26.416739 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 275/548] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:26 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:01:26.423506 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-845289b4-1f92-4b3f-8f67-029365c20425 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] HTTP exception thrown: Cannot 'detach_volume' instance 54af832e-58c7-4e8c-9faf-318c9b33d2d7 while it is in vm_state rescued Sep 09 13:01:26.425169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-845289b4-1f92-4b3f-8f67-029365c20425 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Request method failure captured: Sep 09 13:01:26.425169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: DELETE /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments/9312c3c4-1c94-4c77-af62-829ae7f9f574 HTTP/1.1 Sep 09 13:01:26.425169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:01:26.425169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:01:26.425169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:01:26.425169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:01:26.425169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:01:26.425169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:01:26.425169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:01:26.425169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:01:26.425169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzhNsxk3eImBO1lHZAvrWlWj7GQd9nwQo7dVWRc-D4q4nh-nTZUHAYAOoO00yWUPireTAtc9TmxercfFvEfPNb2QsAP1s4r0eJpff-pJCUKeW5tfgAvQ_8XMZSgUeBfCO_UYcV1LQt5l9z5gmZQwYMqHdUYhSL3od0VdvzDjeaTN7tA Sep 09 13:01:26.425169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:01:26.425169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:01:26.425169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:01:26.425169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:01:26.425169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:01:26.425169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:01:26.425169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: bf202f6eebd442e988e0f7307950a6c8 Sep 09 13:01:26.425169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-611080032 Sep 09 13:01:26.425169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:01:26.425169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:01:26.426783 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bf202f6eebd442e988e0f7307950a6c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bf202f6eebd442e988e0f7307950a6c8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bf202f6eebd442e988e0f7307950a6c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bf202f6eebd442e988e0f7307950a6c8"}]}] Sep 09 13:01:26.426783 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-ServerRescueNegativeTestJSON-611080032 Sep 09 13:01:26.426783 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: bf202f6eebd442e988e0f7307950a6c8 Sep 09 13:01:26.426783 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-611080032 Sep 09 13:01:26.426783 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-ServerRescueNegativeTestJSON-611080032-project Sep 09 13:01:26.426783 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:01:26.426783 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:01:26.426783 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 48f14caeb8f944c6aaf27913972869c7 Sep 09 13:01:26.426783 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-ServerRescueNegativeTestJSON-611080032-project Sep 09 13:01:26.426783 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:01:26.426783 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Cannot 'detach_volume' instance 54af832e-58c7-4e8c-9faf-318c9b33d2d7 while it is in vm_state rescued Sep 09 13:01:26.430869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'server_id': '54af832e-58c7-4e8c-9faf-318c9b33d2d7', 'id': '9312c3c4-1c94-4c77-af62-829ae7f9f574'} Sep 09 13:01:26.430869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:01:26.430869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:01:26.430869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 09 13:01:26.430869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 09 13:01:26.430869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 13:01:26.430869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 13:01:26.430869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 13:01:26.430869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 13:01:26.430869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 54af832e-58c7-4e8c-9faf-318c9b33d2d7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 09 13:01:26.430869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:01:26.430869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:01:26.430869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:01:26.430869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:01:26.430869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:01:26.430869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:01:26.430869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:01:26.430869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:01:26.430869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:01:26.430869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:01:26.432334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 09 13:01:26.432334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 13:01:26.432334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 13:01:26.432334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 13:01:26.432334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 54af832e-58c7-4e8c-9faf-318c9b33d2d7 while it is in vm_state rescued Sep 09 13:01:26.432334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:01:26.432334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:01:26.432334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:01:26.432334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:01:26.432334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:01:26.432334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:01:26.432334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:01:26.432334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:01:26.432334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 54af832e-58c7-4e8c-9faf-318c9b33d2d7 while it is in vm_state rescued Sep 09 13:01:26.432334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:01:26.432334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-845289b4-1f92-4b3f-8f67-029365c20425 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Returning 409 to user: Cannot 'detach_volume' instance 54af832e-58c7-4e8c-9faf-318c9b33d2d7 while it is in vm_state rescued {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:01:26.433522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-845289b4-1f92-4b3f-8f67-029365c20425 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "DELETE /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments/9312c3c4-1c94-4c77-af62-829ae7f9f574" status: 409 len: 152 microversion: 2.1 time: 0.163275 Sep 09 13:01:26.433522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 274/549] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 13:01:26 2022] DELETE /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments/9312c3c4-1c94-4c77-af62-829ae7f9f574 => generated 152 bytes in 165 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 09 13:01:26.436565 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-2d6cd1e7-1ace-4c31-9edb-f2225858a3b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:01:26.437124 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-2d6cd1e7-1ace-4c31-9edb-f2225858a3b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:26.443870 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2d6cd1e7-1ace-4c31-9edb-f2225858a3b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:26.444438 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2d6cd1e7-1ace-4c31-9edb-f2225858a3b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:26.444886 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2d6cd1e7-1ace-4c31-9edb-f2225858a3b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:26.445582 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2d6cd1e7-1ace-4c31-9edb-f2225858a3b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:26.446052 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2d6cd1e7-1ace-4c31-9edb-f2225858a3b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:26.446501 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2d6cd1e7-1ace-4c31-9edb-f2225858a3b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:26.688839 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-2d6cd1e7-1ace-4c31-9edb-f2225858a3b1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "POST /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/action" status: 202 len: 0 microversion: 2.1 time: 0.256472 Sep 09 13:01:26.689595 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 276/550] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 13:01:26 2022] POST /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 13:01:26.697960 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-efa1f0df-c108-4289-9544-a058a5a0ed24 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:26.698614 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-efa1f0df-c108-4289-9544-a058a5a0ed24 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:26.704539 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-efa1f0df-c108-4289-9544-a058a5a0ed24 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:26.705023 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-efa1f0df-c108-4289-9544-a058a5a0ed24 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:26.705723 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-efa1f0df-c108-4289-9544-a058a5a0ed24 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:26.706420 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-efa1f0df-c108-4289-9544-a058a5a0ed24 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:26.706902 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-efa1f0df-c108-4289-9544-a058a5a0ed24 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:26.707328 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-efa1f0df-c108-4289-9544-a058a5a0ed24 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:26.843419 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-efa1f0df-c108-4289-9544-a058a5a0ed24 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:26.859416 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-efa1f0df-c108-4289-9544-a058a5a0ed24 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1722 microversion: 2.1 time: 0.160957 Sep 09 13:01:26.860341 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 275/551] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:26 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:01:27.439901 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c799a6f9-e22a-4a44-8364-dca4d290c9ab tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:27.440633 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-c799a6f9-e22a-4a44-8364-dca4d290c9ab tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:27.447897 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c799a6f9-e22a-4a44-8364-dca4d290c9ab tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:27.448400 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c799a6f9-e22a-4a44-8364-dca4d290c9ab tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:27.448823 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c799a6f9-e22a-4a44-8364-dca4d290c9ab tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:27.449523 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c799a6f9-e22a-4a44-8364-dca4d290c9ab tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:27.450150 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c799a6f9-e22a-4a44-8364-dca4d290c9ab tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:27.451673 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c799a6f9-e22a-4a44-8364-dca4d290c9ab tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:27.467585 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-c799a6f9-e22a-4a44-8364-dca4d290c9ab tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] HTTP exception thrown: Instance cfc21374-47be-4788-8ba9-e2f77ae73d6e could not be found. Sep 09 13:01:27.469239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c799a6f9-e22a-4a44-8364-dca4d290c9ab tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Request method failure captured: Sep 09 13:01:27.469239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e HTTP/1.1 Sep 09 13:01:27.469239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 13:01:27.469239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 13:01:27.469239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 13:01:27.469239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 13:01:27.469239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 13:01:27.469239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 13:01:27.469239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 13:01:27.469239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 13:01:27.469239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGzgEaKb6PZCqo9yxUSEJiFD1xb1LGODlWVgID9cA22eqBLNomTmu2q0yMgjccpW69nnUAUWKXMpFaG8X-sF87AhuIdLNOF9PvF4tjoZWf7SNwd1H5TWSvp_IUIt9lOp_NKX-JRPFLgnDrNAvr9jG5GRaXTb0sVN8rNo6hRRXay_HW10 Sep 09 13:01:27.469239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 13:01:27.469239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 13:01:27.469239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 13:01:27.469239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 13:01:27.469239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 13:01:27.469239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 13:01:27.469239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:01:27.469239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:01:27.469239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 13:01:27.469239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 13:01:27.470770 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ceed6a1f0f4542cbafa4b2a46b16d5fb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}] Sep 09 13:01:27.470770 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:01:27.470770 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:01:27.470770 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:01:27.470770 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:01:27.470770 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 13:01:27.470770 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 13:01:27.470770 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: 63a2902f465f4fd1aed80060c2669259 Sep 09 13:01:27.470770 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:01:27.470770 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: > Sep 09 13:01:27.470770 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Instance cfc21374-47be-4788-8ba9-e2f77ae73d6e could not be found. Sep 09 13:01:27.470770 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'id': 'cfc21374-47be-4788-8ba9-e2f77ae73d6e'} Sep 09 13:01:27.471641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:01:27.471641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:01:27.471641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:01:27.471641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:01:27.471641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:01:27.471641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:01:27.471641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:01:27.471641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:01:27.471641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:01:27.471641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:01:27.471641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfc21374-47be-4788-8ba9-e2f77ae73d6e could not be found. Sep 09 13:01:27.471641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:01:27.471641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:01:27.471641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:01:27.471641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:01:27.471641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:01:27.471641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:01:27.471641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:01:27.471641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:01:27.471641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:01:27.473049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:01:27.473049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:01:27.473049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:01:27.473049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:01:27.473049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:01:27.473049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:01:27.473049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:01:27.473049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfc21374-47be-4788-8ba9-e2f77ae73d6e could not be found. Sep 09 13:01:27.473049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:01:27.473049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:01:27.473049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:01:27.473049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:01:27.473049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:01:27.473049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:01:27.473049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:01:27.473049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:01:27.473049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfc21374-47be-4788-8ba9-e2f77ae73d6e could not be found. Sep 09 13:01:27.473049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:01:27.475362 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c799a6f9-e22a-4a44-8364-dca4d290c9ab tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Returning 404 to user: Instance cfc21374-47be-4788-8ba9-e2f77ae73d6e could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:01:27.475362 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-c799a6f9-e22a-4a44-8364-dca4d290c9ab tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e" status: 404 len: 111 microversion: 2.1 time: 0.035523 Sep 09 13:01:27.475362 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 277/552] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:27 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:01:27.480564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-25d764b9-3bc9-4698-876f-a74b148bd8a1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '.version_select at 0x7f318310e940>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:27.557222 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-25d764b9-3bc9-4698-876f-a74b148bd8a1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1964468938" status: 202 len: 0 microversion: 2.1 time: 0.080359 Sep 09 13:01:27.557743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 276/553] 10.222.0.46 () {58 vars in 1221 bytes} [Fri Sep 9 13:01:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1964468938 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:01:27.885942 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-aa08d7f8-7dd0-4a9b-9016-a631bea4cd39 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:27.886469 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-aa08d7f8-7dd0-4a9b-9016-a631bea4cd39 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:27.892597 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-aa08d7f8-7dd0-4a9b-9016-a631bea4cd39 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:27.893083 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-aa08d7f8-7dd0-4a9b-9016-a631bea4cd39 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:27.893524 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-aa08d7f8-7dd0-4a9b-9016-a631bea4cd39 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:27.894218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-aa08d7f8-7dd0-4a9b-9016-a631bea4cd39 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:27.894699 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-aa08d7f8-7dd0-4a9b-9016-a631bea4cd39 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:27.895127 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-aa08d7f8-7dd0-4a9b-9016-a631bea4cd39 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:27.937310 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-391e5d39-986f-46e4-bd8e-a1c06f8e3573 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:01:27.938292 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-391e5d39-986f-46e4-bd8e-a1c06f8e3573 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:27.946788 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-391e5d39-986f-46e4-bd8e-a1c06f8e3573 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:27.959341 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-391e5d39-986f-46e4-bd8e-a1c06f8e3573 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:27.959866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-391e5d39-986f-46e4-bd8e-a1c06f8e3573 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:27.960629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-391e5d39-986f-46e4-bd8e-a1c06f8e3573 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:27.961083 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-391e5d39-986f-46e4-bd8e-a1c06f8e3573 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:27.961510 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-391e5d39-986f-46e4-bd8e-a1c06f8e3573 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:27.986435 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.objects.instance [None req-391e5d39-986f-46e4-bd8e-a1c06f8e3573 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lazy-loading 'flavor' on Instance uuid 37305bac-ecac-4f89-a340-55d5ffc7a775 {{(pid=127771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:01:28.041719 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-aa08d7f8-7dd0-4a9b-9016-a631bea4cd39 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:28.050254 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-aa08d7f8-7dd0-4a9b-9016-a631bea4cd39 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1722 microversion: 2.1 time: 0.168298 Sep 09 13:01:28.050948 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 278/554] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:27 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:28.416897 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-d41e0485-8a89-4046-bd47-317c5061ed01 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Action: 'create', calling method: .version_select at 0x7f3182f88e50>, body: {"keypair": {"name": "tempest-keypair-1071731942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtbqCyIB1qU0CcdPnt/fEAyWEd086vfV+EcpJV0rqm+LS1hdGASj/WulY3DeiA6KQPr0VWip4bcUdQsqFinB/a3eM10Uneo7hCo0J48PvXdyAkKURWq7pXlsNQGOr8ZOQ=="}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:01:28.433123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-d41e0485-8a89-4046-bd47-317c5061ed01 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Getting quotas for project ceed6a1f0f4542cbafa4b2a46b16d5fb. Resources: {'key_pairs'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:01:28.437368 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-d41e0485-8a89-4046-bd47-317c5061ed01 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Getting quotas for user 63a2902f465f4fd1aed80060c2669259 and project ceed6a1f0f4542cbafa4b2a46b16d5fb. Resources: {'key_pairs'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:01:28.442569 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-391e5d39-986f-46e4-bd8e-a1c06f8e3573 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "POST /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775/action" status: 202 len: 0 microversion: 2.20 time: 0.511265 Sep 09 13:01:28.447306 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 277/555] 10.222.0.46 () {62 vars in 1319 bytes} [Fri Sep 9 13:01:27 2022] POST /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 09 13:01:28.451874 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-cf2d0511-d855-4a86-9982-e91e6e73712c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:28.452577 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-cf2d0511-d855-4a86-9982-e91e6e73712c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:28.459622 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cf2d0511-d855-4a86-9982-e91e6e73712c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:28.462830 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cf2d0511-d855-4a86-9982-e91e6e73712c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:28.462830 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cf2d0511-d855-4a86-9982-e91e6e73712c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:28.462830 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cf2d0511-d855-4a86-9982-e91e6e73712c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:28.462830 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cf2d0511-d855-4a86-9982-e91e6e73712c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:28.463138 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cf2d0511-d855-4a86-9982-e91e6e73712c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:28.493888 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-d41e0485-8a89-4046-bd47-317c5061ed01 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.080868 Sep 09 13:01:28.494524 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 279/556] 10.222.0.46 () {60 vars in 1159 bytes} [Fri Sep 9 13:01:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:01:28.595196 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-cf2d0511-d855-4a86-9982-e91e6e73712c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:28.604026 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-cf2d0511-d855-4a86-9982-e91e6e73712c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:28.605493 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-cf2d0511-d855-4a86-9982-e91e6e73712c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:28.606706 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-cf2d0511-d855-4a86-9982-e91e6e73712c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1720 microversion: 2.20 time: 0.158966 Sep 09 13:01:28.607426 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 278/557] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:28 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:01:29.074474 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-b46f2148-6122-4d34-a855-6aab44ac83ed tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:29.075185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-b46f2148-6122-4d34-a855-6aab44ac83ed tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:29.081412 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b46f2148-6122-4d34-a855-6aab44ac83ed tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:29.081899 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b46f2148-6122-4d34-a855-6aab44ac83ed tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:29.082337 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b46f2148-6122-4d34-a855-6aab44ac83ed tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:29.083108 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b46f2148-6122-4d34-a855-6aab44ac83ed tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:29.084209 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b46f2148-6122-4d34-a855-6aab44ac83ed tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:29.084881 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b46f2148-6122-4d34-a855-6aab44ac83ed tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:29.256177 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-b46f2148-6122-4d34-a855-6aab44ac83ed tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:29.264478 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-b46f2148-6122-4d34-a855-6aab44ac83ed tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1722 microversion: 2.1 time: 0.194065 Sep 09 13:01:29.265040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 280/558] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:29 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:29.633254 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-bddb249e-d62d-4eff-a8cd-07ba80194bf4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:29.633922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-bddb249e-d62d-4eff-a8cd-07ba80194bf4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:29.640853 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bddb249e-d62d-4eff-a8cd-07ba80194bf4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:29.642288 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bddb249e-d62d-4eff-a8cd-07ba80194bf4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:29.642838 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bddb249e-d62d-4eff-a8cd-07ba80194bf4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:29.652552 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bddb249e-d62d-4eff-a8cd-07ba80194bf4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:29.652552 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bddb249e-d62d-4eff-a8cd-07ba80194bf4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:29.652552 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bddb249e-d62d-4eff-a8cd-07ba80194bf4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:29.780864 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-bddb249e-d62d-4eff-a8cd-07ba80194bf4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:29.789073 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-bddb249e-d62d-4eff-a8cd-07ba80194bf4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:29.790651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-bddb249e-d62d-4eff-a8cd-07ba80194bf4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:29.791819 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-bddb249e-d62d-4eff-a8cd-07ba80194bf4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1720 microversion: 2.20 time: 0.163275 Sep 09 13:01:29.792385 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 279/559] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:29 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:01:30.287991 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-978c3440-ac29-4915-9505-417789d64649 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:30.288585 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-978c3440-ac29-4915-9505-417789d64649 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:30.294932 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-978c3440-ac29-4915-9505-417789d64649 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:30.295413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-978c3440-ac29-4915-9505-417789d64649 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:30.295871 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-978c3440-ac29-4915-9505-417789d64649 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:30.296567 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-978c3440-ac29-4915-9505-417789d64649 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:30.297119 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-978c3440-ac29-4915-9505-417789d64649 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:30.297711 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-978c3440-ac29-4915-9505-417789d64649 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:30.503528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-978c3440-ac29-4915-9505-417789d64649 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:30.512891 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-978c3440-ac29-4915-9505-417789d64649 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1728 microversion: 2.1 time: 0.228943 Sep 09 13:01:30.513459 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 281/560] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:30 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1728 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:30.534853 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-81b41c98-78bf-4285-9f57-0cf1170b6900 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:30.535340 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-81b41c98-78bf-4285-9f57-0cf1170b6900 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:30.543365 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-81b41c98-78bf-4285-9f57-0cf1170b6900 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:30.543794 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-81b41c98-78bf-4285-9f57-0cf1170b6900 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:30.544224 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-81b41c98-78bf-4285-9f57-0cf1170b6900 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:30.544912 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-81b41c98-78bf-4285-9f57-0cf1170b6900 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:30.545364 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-81b41c98-78bf-4285-9f57-0cf1170b6900 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:30.545787 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-81b41c98-78bf-4285-9f57-0cf1170b6900 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:30.623394 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-75d8ca71-91e8-48bb-9601-0d5fb489fbe1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-76187167", "imageRef": "355bded2-2225-44b2-af86-f9e1861d05ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4f411e2-e42e-4ab3-86d3-b0b098a1a8fe"}], "security_groups": [{"name": "tempest-securitygroup--479048347"}], "key_name": "tempest-keypair-1071731942", "user_data": "}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:01:30.623942 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-81b41c98-78bf-4285-9f57-0cf1170b6900 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092804 Sep 09 13:01:30.624634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 280/561] 10.222.0.46 () {58 vars in 1275 bytes} [Fri Sep 9 13:01:30 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:01:30.727851 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.network.neutron [None req-75d8ca71-91e8-48bb-9601-0d5fb489fbe1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] validate_networks() for [('c4f411e2-e42e-4ab3-86d3-b0b098a1a8fe', None, None, None, None, None)] {{(pid=127772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:01:30.818393 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0c6c88f4-742c-4f09-afaf-9466f04e88e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:30.819185 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-0c6c88f4-742c-4f09-afaf-9466f04e88e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:30.826276 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0c6c88f4-742c-4f09-afaf-9466f04e88e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:30.827672 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0c6c88f4-742c-4f09-afaf-9466f04e88e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:30.828349 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0c6c88f4-742c-4f09-afaf-9466f04e88e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:30.829300 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0c6c88f4-742c-4f09-afaf-9466f04e88e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:30.829826 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0c6c88f4-742c-4f09-afaf-9466f04e88e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:30.830633 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0c6c88f4-742c-4f09-afaf-9466f04e88e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:31.125348 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-75d8ca71-91e8-48bb-9601-0d5fb489fbe1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Flavor limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:01:31.125565 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-75d8ca71-91e8-48bb-9601-0d5fb489fbe1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Image limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:01:31.126283 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-75d8ca71-91e8-48bb-9601-0d5fb489fbe1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Flavor pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:01:31.126826 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-75d8ca71-91e8-48bb-9601-0d5fb489fbe1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Image pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:01:31.127241 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-75d8ca71-91e8-48bb-9601-0d5fb489fbe1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:01:31.137830 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-75d8ca71-91e8-48bb-9601-0d5fb489fbe1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:31.138308 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-75d8ca71-91e8-48bb-9601-0d5fb489fbe1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:31.138771 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-75d8ca71-91e8-48bb-9601-0d5fb489fbe1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:31.139495 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-75d8ca71-91e8-48bb-9601-0d5fb489fbe1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:31.140252 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-75d8ca71-91e8-48bb-9601-0d5fb489fbe1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:31.140674 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-75d8ca71-91e8-48bb-9601-0d5fb489fbe1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:31.158712 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-75d8ca71-91e8-48bb-9601-0d5fb489fbe1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Getting quotas for project ceed6a1f0f4542cbafa4b2a46b16d5fb. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:01:31.163573 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-75d8ca71-91e8-48bb-9601-0d5fb489fbe1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Getting quotas for user 63a2902f465f4fd1aed80060c2669259 and project ceed6a1f0f4542cbafa4b2a46b16d5fb. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:01:31.176592 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-75d8ca71-91e8-48bb-9601-0d5fb489fbe1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Going to run 1 instances... {{(pid=127772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:01:31.178986 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-75d8ca71-91e8-48bb-9601-0d5fb489fbe1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='355bded2-2225-44b2-af86-f9e1861d05ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:01:31.270637 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-0c6c88f4-742c-4f09-afaf-9466f04e88e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:31.279574 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-0c6c88f4-742c-4f09-afaf-9466f04e88e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:31.281116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-0c6c88f4-742c-4f09-afaf-9466f04e88e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:31.282282 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0c6c88f4-742c-4f09-afaf-9466f04e88e7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1720 microversion: 2.20 time: 0.469006 Sep 09 13:01:31.282879 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 281/562] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:30 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1720 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:01:31.329852 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-75d8ca71-91e8-48bb-9601-0d5fb489fbe1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.710436 Sep 09 13:01:31.337672 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 282/563] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 13:01:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 13:01:31.342869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0996475c-3ef5-4cbe-af9b-8ed9be42a9a1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:31.352551 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-0996475c-3ef5-4cbe-af9b-8ed9be42a9a1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:31.430499 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-0996475c-3ef5-4cbe-af9b-8ed9be42a9a1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:31.439845 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0996475c-3ef5-4cbe-af9b-8ed9be42a9a1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 200 len: 1240 microversion: 2.1 time: 0.100766 Sep 09 13:01:31.440509 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 282/564] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:31 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 1240 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:31.874199 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-2f99fbba-979c-4b63-b9b2-226d67d2d9d0 req-ed425905-6bf2-4dc0-93c8-f230ce73fe63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54af832e-58c7-4e8c-9faf-318c9b33d2d7", "tag": "a964a7f9-bcef-4299-b1fc-2858bd8b14f1"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:01:31.885381 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-2f99fbba-979c-4b63-b9b2-226d67d2d9d0 req-ed425905-6bf2-4dc0-93c8-f230ce73fe63 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:31.886132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-2f99fbba-979c-4b63-b9b2-226d67d2d9d0 req-ed425905-6bf2-4dc0-93c8-f230ce73fe63 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:31.887403 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-2f99fbba-979c-4b63-b9b2-226d67d2d9d0 req-ed425905-6bf2-4dc0-93c8-f230ce73fe63 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:31.899791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-2f99fbba-979c-4b63-b9b2-226d67d2d9d0 req-ed425905-6bf2-4dc0-93c8-f230ce73fe63 service nova] Creating event network-changed:a964a7f9-bcef-4299-b1fc-2858bd8b14f1 for instance 54af832e-58c7-4e8c-9faf-318c9b33d2d7 on hv-cinder-81322 Sep 09 13:01:31.904764 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-2f99fbba-979c-4b63-b9b2-226d67d2d9d0 req-ed425905-6bf2-4dc0-93c8-f230ce73fe63 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034405 Sep 09 13:01:31.906687 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 283/565] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:01:32.309397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-21a43e45-4a3a-446e-9ef1-eba247dc82e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:32.310422 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-21a43e45-4a3a-446e-9ef1-eba247dc82e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:32.318956 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-21a43e45-4a3a-446e-9ef1-eba247dc82e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:32.319800 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-21a43e45-4a3a-446e-9ef1-eba247dc82e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:32.320460 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-21a43e45-4a3a-446e-9ef1-eba247dc82e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:32.321403 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-21a43e45-4a3a-446e-9ef1-eba247dc82e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:32.322038 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-21a43e45-4a3a-446e-9ef1-eba247dc82e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:32.322468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-21a43e45-4a3a-446e-9ef1-eba247dc82e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:32.466003 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-aab08a70-cd90-4a6d-8a98-cf72c1ba5c00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:32.466738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-aab08a70-cd90-4a6d-8a98-cf72c1ba5c00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:32.476774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-aab08a70-cd90-4a6d-8a98-cf72c1ba5c00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:32.477626 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-aab08a70-cd90-4a6d-8a98-cf72c1ba5c00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:32.477743 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-aab08a70-cd90-4a6d-8a98-cf72c1ba5c00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:32.478563 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-aab08a70-cd90-4a6d-8a98-cf72c1ba5c00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:32.479191 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-aab08a70-cd90-4a6d-8a98-cf72c1ba5c00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:32.479793 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-aab08a70-cd90-4a6d-8a98-cf72c1ba5c00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:32.483359 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-21a43e45-4a3a-446e-9ef1-eba247dc82e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:32.502758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-21a43e45-4a3a-446e-9ef1-eba247dc82e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:32.504721 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-21a43e45-4a3a-446e-9ef1-eba247dc82e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:32.506769 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-21a43e45-4a3a-446e-9ef1-eba247dc82e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1720 microversion: 2.20 time: 0.201210 Sep 09 13:01:32.518505 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 283/566] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:32 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1720 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:01:32.567740 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-aab08a70-cd90-4a6d-8a98-cf72c1ba5c00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:32.576249 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-aab08a70-cd90-4a6d-8a98-cf72c1ba5c00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 200 len: 1244 microversion: 2.1 time: 0.115441 Sep 09 13:01:32.576839 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 284/567] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:32 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 1244 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:01:33.532342 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-462d225e-2a7b-4a16-b803-aaec58e8870c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:33.532943 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-462d225e-2a7b-4a16-b803-aaec58e8870c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:33.539629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-462d225e-2a7b-4a16-b803-aaec58e8870c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:33.540106 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-462d225e-2a7b-4a16-b803-aaec58e8870c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:33.540538 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-462d225e-2a7b-4a16-b803-aaec58e8870c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:33.541221 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-462d225e-2a7b-4a16-b803-aaec58e8870c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:33.541667 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-462d225e-2a7b-4a16-b803-aaec58e8870c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:33.542086 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-462d225e-2a7b-4a16-b803-aaec58e8870c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:33.599936 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-91ff51e3-ebc2-46ee-a2eb-d53c474e8ed4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:33.600547 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-91ff51e3-ebc2-46ee-a2eb-d53c474e8ed4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:33.607023 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-91ff51e3-ebc2-46ee-a2eb-d53c474e8ed4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:33.607509 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-91ff51e3-ebc2-46ee-a2eb-d53c474e8ed4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:33.607980 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-91ff51e3-ebc2-46ee-a2eb-d53c474e8ed4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:33.608675 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-91ff51e3-ebc2-46ee-a2eb-d53c474e8ed4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:33.609132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-91ff51e3-ebc2-46ee-a2eb-d53c474e8ed4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:33.609560 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-91ff51e3-ebc2-46ee-a2eb-d53c474e8ed4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:33.671078 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-91ff51e3-ebc2-46ee-a2eb-d53c474e8ed4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:33.672358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-462d225e-2a7b-4a16-b803-aaec58e8870c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:33.679649 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-91ff51e3-ebc2-46ee-a2eb-d53c474e8ed4 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 200 len: 1300 microversion: 2.1 time: 0.083786 Sep 09 13:01:33.680260 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 285/568] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:33 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 1300 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:01:33.681418 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-462d225e-2a7b-4a16-b803-aaec58e8870c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:33.682876 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-462d225e-2a7b-4a16-b803-aaec58e8870c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:33.684021 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-462d225e-2a7b-4a16-b803-aaec58e8870c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1720 microversion: 2.20 time: 0.155541 Sep 09 13:01:33.684562 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 284/569] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:33 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:01:33.919374 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-e3ac870e-d216-4525-ba0a-13d3c0a41a3a req-667d5c37-c473-436e-89bf-eee7e63148bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54af832e-58c7-4e8c-9faf-318c9b33d2d7", "tag": "a964a7f9-bcef-4299-b1fc-2858bd8b14f1"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:01:33.929664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-e3ac870e-d216-4525-ba0a-13d3c0a41a3a req-667d5c37-c473-436e-89bf-eee7e63148bd service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:33.930149 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-e3ac870e-d216-4525-ba0a-13d3c0a41a3a req-667d5c37-c473-436e-89bf-eee7e63148bd service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:33.931727 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-e3ac870e-d216-4525-ba0a-13d3c0a41a3a req-667d5c37-c473-436e-89bf-eee7e63148bd service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:33.943359 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-e3ac870e-d216-4525-ba0a-13d3c0a41a3a req-667d5c37-c473-436e-89bf-eee7e63148bd service nova] Creating event network-changed:a964a7f9-bcef-4299-b1fc-2858bd8b14f1 for instance 54af832e-58c7-4e8c-9faf-318c9b33d2d7 on hv-cinder-81322 Sep 09 13:01:33.947952 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-e3ac870e-d216-4525-ba0a-13d3c0a41a3a req-667d5c37-c473-436e-89bf-eee7e63148bd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032311 Sep 09 13:01:33.948553 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 286/570] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:01:34.703129 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-66423a80-ab1b-42a8-a88e-d7cd10e30088 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:34.707044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-66423a80-ab1b-42a8-a88e-d7cd10e30088 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:34.711328 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-66423a80-ab1b-42a8-a88e-d7cd10e30088 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:34.711903 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-66423a80-ab1b-42a8-a88e-d7cd10e30088 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:34.712417 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-66423a80-ab1b-42a8-a88e-d7cd10e30088 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:34.713176 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-91228025-801b-477f-843a-8e5285cce4d4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:34.713662 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-66423a80-ab1b-42a8-a88e-d7cd10e30088 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:34.713764 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-66423a80-ab1b-42a8-a88e-d7cd10e30088 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:34.714309 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-66423a80-ab1b-42a8-a88e-d7cd10e30088 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:34.714636 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-91228025-801b-477f-843a-8e5285cce4d4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:34.720095 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:01:34.721796 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-91228025-801b-477f-843a-8e5285cce4d4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:34.722286 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-91228025-801b-477f-843a-8e5285cce4d4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:34.722760 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-91228025-801b-477f-843a-8e5285cce4d4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:34.723639 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-91228025-801b-477f-843a-8e5285cce4d4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:34.724741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-91228025-801b-477f-843a-8e5285cce4d4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:34.725357 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-91228025-801b-477f-843a-8e5285cce4d4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:34.788823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-66423a80-ab1b-42a8-a88e-d7cd10e30088 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:34.796851 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-66423a80-ab1b-42a8-a88e-d7cd10e30088 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 200 len: 1298 microversion: 2.1 time: 0.097627 Sep 09 13:01:34.797529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 285/571] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:34 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 1298 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:35.047178 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-91228025-801b-477f-843a-8e5285cce4d4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:35.055679 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-91228025-801b-477f-843a-8e5285cce4d4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:35.057132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-91228025-801b-477f-843a-8e5285cce4d4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:35.058327 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-91228025-801b-477f-843a-8e5285cce4d4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1720 microversion: 2.20 time: 0.352664 Sep 09 13:01:35.059137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 287/572] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:34 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1720 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:01:35.821110 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-217ca0c4-244a-43b0-9ddb-e2df542c375b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:35.821733 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-217ca0c4-244a-43b0-9ddb-e2df542c375b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:35.828268 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-217ca0c4-244a-43b0-9ddb-e2df542c375b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:35.835540 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-217ca0c4-244a-43b0-9ddb-e2df542c375b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:35.835540 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-217ca0c4-244a-43b0-9ddb-e2df542c375b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:35.835540 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-217ca0c4-244a-43b0-9ddb-e2df542c375b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:35.835540 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-217ca0c4-244a-43b0-9ddb-e2df542c375b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:35.835892 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-217ca0c4-244a-43b0-9ddb-e2df542c375b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:35.967396 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-217ca0c4-244a-43b0-9ddb-e2df542c375b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:35.972826 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-217ca0c4-244a-43b0-9ddb-e2df542c375b tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 200 len: 1365 microversion: 2.1 time: 0.155828 Sep 09 13:01:35.973396 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 286/573] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:35 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:36.086593 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e31ed1f9-43f8-439f-b175-3a4fc8ff3f4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:36.087358 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e31ed1f9-43f8-439f-b175-3a4fc8ff3f4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:36.093773 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e31ed1f9-43f8-439f-b175-3a4fc8ff3f4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:36.094329 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e31ed1f9-43f8-439f-b175-3a4fc8ff3f4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:36.094875 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e31ed1f9-43f8-439f-b175-3a4fc8ff3f4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:36.095640 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e31ed1f9-43f8-439f-b175-3a4fc8ff3f4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:36.096156 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e31ed1f9-43f8-439f-b175-3a4fc8ff3f4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:36.096718 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e31ed1f9-43f8-439f-b175-3a4fc8ff3f4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:36.260900 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-2f15e34f-0942-43ae-8a01-9e48dc54aff9 req-acf9b4b1-d690-44a4-aa39-277e895c24b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac5e13d7-1743-4f4a-9768-51f9b57e7811", "tag": "a0f07801-d4b2-4e0d-ad5d-be7c875c2cca"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:01:36.271619 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-2f15e34f-0942-43ae-8a01-9e48dc54aff9 req-acf9b4b1-d690-44a4-aa39-277e895c24b7 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:36.272190 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-2f15e34f-0942-43ae-8a01-9e48dc54aff9 req-acf9b4b1-d690-44a4-aa39-277e895c24b7 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:36.272624 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-2f15e34f-0942-43ae-8a01-9e48dc54aff9 req-acf9b4b1-d690-44a4-aa39-277e895c24b7 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:36.285272 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-2f15e34f-0942-43ae-8a01-9e48dc54aff9 req-acf9b4b1-d690-44a4-aa39-277e895c24b7 service nova] Creating event network-changed:a0f07801-d4b2-4e0d-ad5d-be7c875c2cca for instance ac5e13d7-1743-4f4a-9768-51f9b57e7811 on hv-cinder-81322 Sep 09 13:01:36.290286 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-2f15e34f-0942-43ae-8a01-9e48dc54aff9 req-acf9b4b1-d690-44a4-aa39-277e895c24b7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033434 Sep 09 13:01:36.290911 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 287/574] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:01:36.417369 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e31ed1f9-43f8-439f-b175-3a4fc8ff3f4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:36.422273 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:01:36.429714 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e31ed1f9-43f8-439f-b175-3a4fc8ff3f4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:36.433829 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e31ed1f9-43f8-439f-b175-3a4fc8ff3f4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:36.436257 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e31ed1f9-43f8-439f-b175-3a4fc8ff3f4e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1720 microversion: 2.20 time: 0.354586 Sep 09 13:01:36.436980 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 288/575] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:36 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1720 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:01:36.998380 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e9d5fa3d-d4a6-44d4-85e5-36af60862e84 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:36.999102 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-e9d5fa3d-d4a6-44d4-85e5-36af60862e84 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:37.005369 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e9d5fa3d-d4a6-44d4-85e5-36af60862e84 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:37.005857 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e9d5fa3d-d4a6-44d4-85e5-36af60862e84 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:37.006297 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e9d5fa3d-d4a6-44d4-85e5-36af60862e84 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:37.007716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e9d5fa3d-d4a6-44d4-85e5-36af60862e84 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:37.008187 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e9d5fa3d-d4a6-44d4-85e5-36af60862e84 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:37.008804 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e9d5fa3d-d4a6-44d4-85e5-36af60862e84 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:37.142952 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e9d5fa3d-d4a6-44d4-85e5-36af60862e84 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:37.151352 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-e9d5fa3d-d4a6-44d4-85e5-36af60862e84 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 200 len: 1365 microversion: 2.1 time: 0.158105 Sep 09 13:01:37.151911 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 288/576] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:36 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:37.463156 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-31f6bc3d-6be3-4b51-85a5-df19d5f2e463 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:37.463670 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-31f6bc3d-6be3-4b51-85a5-df19d5f2e463 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:37.471390 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-31f6bc3d-6be3-4b51-85a5-df19d5f2e463 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:37.471872 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-31f6bc3d-6be3-4b51-85a5-df19d5f2e463 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:37.472309 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-31f6bc3d-6be3-4b51-85a5-df19d5f2e463 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:37.473006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-31f6bc3d-6be3-4b51-85a5-df19d5f2e463 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:37.473439 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-31f6bc3d-6be3-4b51-85a5-df19d5f2e463 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:37.473861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-31f6bc3d-6be3-4b51-85a5-df19d5f2e463 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:37.601367 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-31f6bc3d-6be3-4b51-85a5-df19d5f2e463 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:37.609284 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-31f6bc3d-6be3-4b51-85a5-df19d5f2e463 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:37.610749 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-31f6bc3d-6be3-4b51-85a5-df19d5f2e463 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:37.611886 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-31f6bc3d-6be3-4b51-85a5-df19d5f2e463 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1720 microversion: 2.20 time: 0.152773 Sep 09 13:01:37.612442 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 289/577] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:37 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:01:38.231858 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-3c58c43a-ccf7-4ca6-82b0-e6ee428af15a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:38.232475 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-3c58c43a-ccf7-4ca6-82b0-e6ee428af15a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:38.238356 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3c58c43a-ccf7-4ca6-82b0-e6ee428af15a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:38.238891 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3c58c43a-ccf7-4ca6-82b0-e6ee428af15a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:38.239325 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3c58c43a-ccf7-4ca6-82b0-e6ee428af15a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:38.240718 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3c58c43a-ccf7-4ca6-82b0-e6ee428af15a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:38.241172 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3c58c43a-ccf7-4ca6-82b0-e6ee428af15a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:38.241597 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3c58c43a-ccf7-4ca6-82b0-e6ee428af15a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:38.372830 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-3c58c43a-ccf7-4ca6-82b0-e6ee428af15a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:38.380798 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-3c58c43a-ccf7-4ca6-82b0-e6ee428af15a tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 200 len: 1365 microversion: 2.1 time: 0.210824 Sep 09 13:01:38.381266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 289/578] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:38 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:38.637050 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a5d73f87-2f0d-4506-987e-7aa3b71b5a09 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:38.637573 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a5d73f87-2f0d-4506-987e-7aa3b71b5a09 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:38.643920 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a5d73f87-2f0d-4506-987e-7aa3b71b5a09 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:38.644397 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a5d73f87-2f0d-4506-987e-7aa3b71b5a09 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:38.644826 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a5d73f87-2f0d-4506-987e-7aa3b71b5a09 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:38.645505 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a5d73f87-2f0d-4506-987e-7aa3b71b5a09 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:38.646566 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a5d73f87-2f0d-4506-987e-7aa3b71b5a09 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:38.646912 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a5d73f87-2f0d-4506-987e-7aa3b71b5a09 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:38.777773 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a5d73f87-2f0d-4506-987e-7aa3b71b5a09 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:38.786050 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a5d73f87-2f0d-4506-987e-7aa3b71b5a09 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:38.788219 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a5d73f87-2f0d-4506-987e-7aa3b71b5a09 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:38.789375 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a5d73f87-2f0d-4506-987e-7aa3b71b5a09 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1720 microversion: 2.20 time: 0.156320 Sep 09 13:01:38.789947 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 290/579] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:38 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:01:39.403403 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-aae30f3e-3d1a-4f7e-bf7f-3b755f891547 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:39.403945 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-aae30f3e-3d1a-4f7e-bf7f-3b755f891547 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:39.410388 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aae30f3e-3d1a-4f7e-bf7f-3b755f891547 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:39.410904 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aae30f3e-3d1a-4f7e-bf7f-3b755f891547 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:39.411353 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aae30f3e-3d1a-4f7e-bf7f-3b755f891547 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:39.412129 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aae30f3e-3d1a-4f7e-bf7f-3b755f891547 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:39.412582 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aae30f3e-3d1a-4f7e-bf7f-3b755f891547 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:39.413006 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aae30f3e-3d1a-4f7e-bf7f-3b755f891547 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:39.541888 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-aae30f3e-3d1a-4f7e-bf7f-3b755f891547 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:39.544192 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:01:39.550148 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-aae30f3e-3d1a-4f7e-bf7f-3b755f891547 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 200 len: 1365 microversion: 2.1 time: 0.150700 Sep 09 13:01:39.557129 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 290/580] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:39 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:01:39.882442 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-5ffc4a55-a435-4329-88d2-744d5fb2c77f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:39.883074 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-5ffc4a55-a435-4329-88d2-744d5fb2c77f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:39.888937 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5ffc4a55-a435-4329-88d2-744d5fb2c77f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:39.889416 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5ffc4a55-a435-4329-88d2-744d5fb2c77f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:39.889848 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5ffc4a55-a435-4329-88d2-744d5fb2c77f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:39.890559 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5ffc4a55-a435-4329-88d2-744d5fb2c77f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:39.891009 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5ffc4a55-a435-4329-88d2-744d5fb2c77f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:39.891427 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5ffc4a55-a435-4329-88d2-744d5fb2c77f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:40.017432 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-5ffc4a55-a435-4329-88d2-744d5fb2c77f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:40.025531 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-5ffc4a55-a435-4329-88d2-744d5fb2c77f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:40.027021 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-5ffc4a55-a435-4329-88d2-744d5fb2c77f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:40.028177 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-5ffc4a55-a435-4329-88d2-744d5fb2c77f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1741 microversion: 2.20 time: 0.206936 Sep 09 13:01:40.028732 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 291/581] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:39 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1741 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:01:40.573604 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d3a82239-ae74-4dd1-a050-7069de730b70 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:40.574214 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-d3a82239-ae74-4dd1-a050-7069de730b70 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:40.581299 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d3a82239-ae74-4dd1-a050-7069de730b70 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:40.581812 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d3a82239-ae74-4dd1-a050-7069de730b70 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:40.582248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d3a82239-ae74-4dd1-a050-7069de730b70 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:40.582966 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d3a82239-ae74-4dd1-a050-7069de730b70 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:40.583720 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d3a82239-ae74-4dd1-a050-7069de730b70 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:40.584150 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d3a82239-ae74-4dd1-a050-7069de730b70 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:40.714791 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-d3a82239-ae74-4dd1-a050-7069de730b70 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:40.722532 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d3a82239-ae74-4dd1-a050-7069de730b70 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 200 len: 1365 microversion: 2.1 time: 0.153067 Sep 09 13:01:40.723369 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 291/582] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:40 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:41.054325 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-de1c96dc-da88-4b96-a7d3-6be719da5b29 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:41.055031 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-de1c96dc-da88-4b96-a7d3-6be719da5b29 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:41.061449 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-de1c96dc-da88-4b96-a7d3-6be719da5b29 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:41.061933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-de1c96dc-da88-4b96-a7d3-6be719da5b29 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:41.062367 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-de1c96dc-da88-4b96-a7d3-6be719da5b29 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:41.063086 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-de1c96dc-da88-4b96-a7d3-6be719da5b29 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:41.063537 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-de1c96dc-da88-4b96-a7d3-6be719da5b29 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:41.063957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-de1c96dc-da88-4b96-a7d3-6be719da5b29 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:41.149707 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=2 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:01:41.171891 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=10 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:01:41.199812 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-de1c96dc-da88-4b96-a7d3-6be719da5b29 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:41.208158 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-de1c96dc-da88-4b96-a7d3-6be719da5b29 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:41.210257 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-de1c96dc-da88-4b96-a7d3-6be719da5b29 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:41.211474 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-de1c96dc-da88-4b96-a7d3-6be719da5b29 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1741 microversion: 2.20 time: 0.161175 Sep 09 13:01:41.212027 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 292/583] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:41 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:01:41.746849 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-75389349-24fa-46eb-9396-5666b3a2351d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:41.748029 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-75389349-24fa-46eb-9396-5666b3a2351d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:41.749916 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=2 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:01:41.755725 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-75389349-24fa-46eb-9396-5666b3a2351d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:41.756253 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-75389349-24fa-46eb-9396-5666b3a2351d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:41.756724 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-75389349-24fa-46eb-9396-5666b3a2351d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:41.757466 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-75389349-24fa-46eb-9396-5666b3a2351d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:41.757922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-75389349-24fa-46eb-9396-5666b3a2351d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:41.758352 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-75389349-24fa-46eb-9396-5666b3a2351d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:41.895061 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-75389349-24fa-46eb-9396-5666b3a2351d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:41.902965 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-75389349-24fa-46eb-9396-5666b3a2351d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 200 len: 1365 microversion: 2.1 time: 0.159886 Sep 09 13:01:41.903577 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 292/584] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:41 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:42.247316 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c24daff2-25f4-4f1f-bb2b-8e7ec9b13316 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:42.247316 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-c24daff2-25f4-4f1f-bb2b-8e7ec9b13316 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:42.247316 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c24daff2-25f4-4f1f-bb2b-8e7ec9b13316 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:42.247316 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c24daff2-25f4-4f1f-bb2b-8e7ec9b13316 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:42.248690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c24daff2-25f4-4f1f-bb2b-8e7ec9b13316 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:42.250728 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c24daff2-25f4-4f1f-bb2b-8e7ec9b13316 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:42.251544 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c24daff2-25f4-4f1f-bb2b-8e7ec9b13316 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:42.252224 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c24daff2-25f4-4f1f-bb2b-8e7ec9b13316 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:42.412417 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c24daff2-25f4-4f1f-bb2b-8e7ec9b13316 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:42.443002 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c24daff2-25f4-4f1f-bb2b-8e7ec9b13316 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:42.446183 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c24daff2-25f4-4f1f-bb2b-8e7ec9b13316 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:42.447763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-c24daff2-25f4-4f1f-bb2b-8e7ec9b13316 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1736 microversion: 2.20 time: 0.215013 Sep 09 13:01:42.448416 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 293/585] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:42 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:01:42.797819 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-095463e2-ed54-4772-a1e1-acb6c45a064b req-261442cd-c1fd-45d0-a7a4-92b50c49145b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac5e13d7-1743-4f4a-9768-51f9b57e7811", "name": "network-vif-plugged", "status": "completed", "tag": "a0f07801-d4b2-4e0d-ad5d-be7c875c2cca"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:01:42.809784 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 13:01:42.809784 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Fri Sep 9 13:01:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.46) !!! Sep 09 13:01:42.813320 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-095463e2-ed54-4772-a1e1-acb6c45a064b req-261442cd-c1fd-45d0-a7a4-92b50c49145b service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:42.814117 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-095463e2-ed54-4772-a1e1-acb6c45a064b req-261442cd-c1fd-45d0-a7a4-92b50c49145b service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:42.814818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-095463e2-ed54-4772-a1e1-acb6c45a064b req-261442cd-c1fd-45d0-a7a4-92b50c49145b service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:42.832921 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-095463e2-ed54-4772-a1e1-acb6c45a064b req-261442cd-c1fd-45d0-a7a4-92b50c49145b service nova] Creating event network-vif-plugged:a0f07801-d4b2-4e0d-ad5d-be7c875c2cca for instance ac5e13d7-1743-4f4a-9768-51f9b57e7811 on hv-cinder-81322 Sep 09 13:01:42.838818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-095463e2-ed54-4772-a1e1-acb6c45a064b req-261442cd-c1fd-45d0-a7a4-92b50c49145b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044099 Sep 09 13:01:42.839659 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 293/586] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:01:42.927461 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-3c8dc1e2-c781-4241-b52a-a73873b16fdc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:42.928079 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-3c8dc1e2-c781-4241-b52a-a73873b16fdc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:42.934997 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3c8dc1e2-c781-4241-b52a-a73873b16fdc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:42.935493 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3c8dc1e2-c781-4241-b52a-a73873b16fdc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:42.936026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3c8dc1e2-c781-4241-b52a-a73873b16fdc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:42.936968 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3c8dc1e2-c781-4241-b52a-a73873b16fdc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:42.937435 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3c8dc1e2-c781-4241-b52a-a73873b16fdc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:42.937867 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3c8dc1e2-c781-4241-b52a-a73873b16fdc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:43.141110 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-3c8dc1e2-c781-4241-b52a-a73873b16fdc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:43.151544 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-3c8dc1e2-c781-4241-b52a-a73873b16fdc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 200 len: 1365 microversion: 2.1 time: 0.228146 Sep 09 13:01:43.152560 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 294/587] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:42 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:43.483127 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-825d2bad-dc19-4e71-a079-d31ce63891d3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:43.483867 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-825d2bad-dc19-4e71-a079-d31ce63891d3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:43.490684 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-825d2bad-dc19-4e71-a079-d31ce63891d3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:43.492054 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-825d2bad-dc19-4e71-a079-d31ce63891d3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:43.492574 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-825d2bad-dc19-4e71-a079-d31ce63891d3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:43.493363 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-825d2bad-dc19-4e71-a079-d31ce63891d3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:43.494032 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-825d2bad-dc19-4e71-a079-d31ce63891d3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:43.494568 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-825d2bad-dc19-4e71-a079-d31ce63891d3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:43.660726 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-825d2bad-dc19-4e71-a079-d31ce63891d3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:43.671187 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-825d2bad-dc19-4e71-a079-d31ce63891d3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:43.671882 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-825d2bad-dc19-4e71-a079-d31ce63891d3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:43.674125 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-825d2bad-dc19-4e71-a079-d31ce63891d3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1736 microversion: 2.20 time: 0.198720 Sep 09 13:01:43.674878 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 294/588] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:43 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:01:44.181973 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-9c6b034f-e954-402f-8b5c-0cd923eee068 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:44.183235 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-9c6b034f-e954-402f-8b5c-0cd923eee068 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:44.190451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9c6b034f-e954-402f-8b5c-0cd923eee068 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:44.190960 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9c6b034f-e954-402f-8b5c-0cd923eee068 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:44.191619 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9c6b034f-e954-402f-8b5c-0cd923eee068 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:44.192487 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9c6b034f-e954-402f-8b5c-0cd923eee068 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:44.193098 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9c6b034f-e954-402f-8b5c-0cd923eee068 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:44.193684 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9c6b034f-e954-402f-8b5c-0cd923eee068 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:44.356803 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-9c6b034f-e954-402f-8b5c-0cd923eee068 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:44.365380 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-9c6b034f-e954-402f-8b5c-0cd923eee068 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 200 len: 1365 microversion: 2.1 time: 0.190569 Sep 09 13:01:44.368400 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 295/589] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:44 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:44.700620 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-5a86d8c3-793f-4f11-9cd1-dcf96aa2ffed tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:44.701241 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-5a86d8c3-793f-4f11-9cd1-dcf96aa2ffed tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:44.708451 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a86d8c3-793f-4f11-9cd1-dcf96aa2ffed tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:44.709210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a86d8c3-793f-4f11-9cd1-dcf96aa2ffed tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:44.709847 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a86d8c3-793f-4f11-9cd1-dcf96aa2ffed tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:44.710762 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a86d8c3-793f-4f11-9cd1-dcf96aa2ffed tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:44.711292 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a86d8c3-793f-4f11-9cd1-dcf96aa2ffed tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:44.718710 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a86d8c3-793f-4f11-9cd1-dcf96aa2ffed tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:44.861322 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-64cf7fc7-06a1-4e23-a981-5e53de0d1c32 req-52b673c8-6986-4b97-8afb-7af971c5ff94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37305bac-ecac-4f89-a340-55d5ffc7a775", "name": "network-vif-plugged", "status": "completed", "tag": "10813693-1d59-4806-bfad-10fa8cfeba3b"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:01:44.872568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-64cf7fc7-06a1-4e23-a981-5e53de0d1c32 req-52b673c8-6986-4b97-8afb-7af971c5ff94 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:44.873048 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-64cf7fc7-06a1-4e23-a981-5e53de0d1c32 req-52b673c8-6986-4b97-8afb-7af971c5ff94 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:44.873764 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-64cf7fc7-06a1-4e23-a981-5e53de0d1c32 req-52b673c8-6986-4b97-8afb-7af971c5ff94 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:44.885488 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-64cf7fc7-06a1-4e23-a981-5e53de0d1c32 req-52b673c8-6986-4b97-8afb-7af971c5ff94 service nova] Creating event network-vif-plugged:10813693-1d59-4806-bfad-10fa8cfeba3b for instance 37305bac-ecac-4f89-a340-55d5ffc7a775 on hv-cinder-81322 Sep 09 13:01:44.886464 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-5a86d8c3-793f-4f11-9cd1-dcf96aa2ffed tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:44.890970 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-64cf7fc7-06a1-4e23-a981-5e53de0d1c32 req-52b673c8-6986-4b97-8afb-7af971c5ff94 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033631 Sep 09 13:01:44.910400 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 296/590] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:01:44.911009 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-5a86d8c3-793f-4f11-9cd1-dcf96aa2ffed tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:44.911009 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-5a86d8c3-793f-4f11-9cd1-dcf96aa2ffed tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:44.911009 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-5a86d8c3-793f-4f11-9cd1-dcf96aa2ffed tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1736 microversion: 2.20 time: 0.201538 Sep 09 13:01:44.911314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 295/591] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:44 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1736 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:01:45.397593 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-6f7558cb-52a1-4eb6-b2fb-7567e3d25e09 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:45.398233 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-6f7558cb-52a1-4eb6-b2fb-7567e3d25e09 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:45.405186 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6f7558cb-52a1-4eb6-b2fb-7567e3d25e09 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:45.405673 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6f7558cb-52a1-4eb6-b2fb-7567e3d25e09 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:45.406105 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6f7558cb-52a1-4eb6-b2fb-7567e3d25e09 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:45.406854 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6f7558cb-52a1-4eb6-b2fb-7567e3d25e09 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:45.407351 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6f7558cb-52a1-4eb6-b2fb-7567e3d25e09 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:45.407861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6f7558cb-52a1-4eb6-b2fb-7567e3d25e09 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:45.551176 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ae781a06-2087-4a1a-94f2-11e4c07bcd4c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-674450124"}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:01:45.552062 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ae781a06-2087-4a1a-94f2-11e4c07bcd4c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:45.560411 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ae781a06-2087-4a1a-94f2-11e4c07bcd4c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:45.560651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ae781a06-2087-4a1a-94f2-11e4c07bcd4c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:45.561084 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ae781a06-2087-4a1a-94f2-11e4c07bcd4c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:45.562443 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ae781a06-2087-4a1a-94f2-11e4c07bcd4c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:45.562928 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ae781a06-2087-4a1a-94f2-11e4c07bcd4c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:45.563803 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ae781a06-2087-4a1a-94f2-11e4c07bcd4c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:45.582332 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-6f7558cb-52a1-4eb6-b2fb-7567e3d25e09 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:45.592543 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-6f7558cb-52a1-4eb6-b2fb-7567e3d25e09 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 200 len: 1365 microversion: 2.1 time: 0.199498 Sep 09 13:01:45.597737 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 297/592] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:45 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:45.720784 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.network.security_group_api [None req-ae781a06-2087-4a1a-94f2-11e4c07bcd4c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Removing security group c4265b42-d283-41c0-81a4-54d8c0c55c38 from port 0f732f85-125a-41ad-8d5f-adfe587313de Sep 09 13:01:45.925309 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-34289afc-6709-468e-88db-526712162a84 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:45.926077 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-34289afc-6709-468e-88db-526712162a84 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:45.932741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-34289afc-6709-468e-88db-526712162a84 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:45.933408 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-34289afc-6709-468e-88db-526712162a84 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:45.933945 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-34289afc-6709-468e-88db-526712162a84 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:45.934802 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-34289afc-6709-468e-88db-526712162a84 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:45.935387 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-34289afc-6709-468e-88db-526712162a84 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:45.935979 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-34289afc-6709-468e-88db-526712162a84 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:46.090674 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-34289afc-6709-468e-88db-526712162a84 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:46.105448 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-34289afc-6709-468e-88db-526712162a84 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:46.107356 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-34289afc-6709-468e-88db-526712162a84 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:46.108761 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-34289afc-6709-468e-88db-526712162a84 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1736 microversion: 2.20 time: 0.187476 Sep 09 13:01:46.109618 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 298/593] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:45 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:01:46.184430 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ae781a06-2087-4a1a-94f2-11e4c07bcd4c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "POST /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c/action" status: 202 len: 0 microversion: 2.1 time: 0.637011 Sep 09 13:01:46.193295 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-1bedd6cb-2c47-497b-ad0e-72302ca98b1c req-346bb301-3aef-4d4f-92e5-570d45740eee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c", "tag": "0f732f85-125a-41ad-8d5f-adfe587313de"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:01:46.195014 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 296/594] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 13:01:45 2022] POST /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c/action => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:01:46.214284 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-1bedd6cb-2c47-497b-ad0e-72302ca98b1c req-346bb301-3aef-4d4f-92e5-570d45740eee service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:46.218455 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-1bedd6cb-2c47-497b-ad0e-72302ca98b1c req-346bb301-3aef-4d4f-92e5-570d45740eee service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:46.218455 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-1bedd6cb-2c47-497b-ad0e-72302ca98b1c req-346bb301-3aef-4d4f-92e5-570d45740eee service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:46.242905 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-1bedd6cb-2c47-497b-ad0e-72302ca98b1c req-346bb301-3aef-4d4f-92e5-570d45740eee service nova] Creating event network-changed:0f732f85-125a-41ad-8d5f-adfe587313de for instance 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c on hv-cinder-81322 Sep 09 13:01:46.254287 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-1bedd6cb-2c47-497b-ad0e-72302ca98b1c req-346bb301-3aef-4d4f-92e5-570d45740eee service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064966 Sep 09 13:01:46.257043 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 299/595] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:01:46.618660 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-3850e19d-48af-4e73-979f-723d427a4d66 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:46.619314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-3850e19d-48af-4e73-979f-723d427a4d66 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:46.629303 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3850e19d-48af-4e73-979f-723d427a4d66 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:46.629806 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3850e19d-48af-4e73-979f-723d427a4d66 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:46.630256 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3850e19d-48af-4e73-979f-723d427a4d66 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:46.631626 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3850e19d-48af-4e73-979f-723d427a4d66 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:46.632123 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3850e19d-48af-4e73-979f-723d427a4d66 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:46.633498 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3850e19d-48af-4e73-979f-723d427a4d66 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:46.799549 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-3850e19d-48af-4e73-979f-723d427a4d66 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:46.810368 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-3850e19d-48af-4e73-979f-723d427a4d66 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 200 len: 1555 microversion: 2.1 time: 0.196810 Sep 09 13:01:46.812894 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 297/596] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:46 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 1555 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:46.842001 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-4bca5652-17ab-4a59-bd82-466b65d01a68 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:46.842757 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-4bca5652-17ab-4a59-bd82-466b65d01a68 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:46.853935 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4bca5652-17ab-4a59-bd82-466b65d01a68 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:46.859309 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4bca5652-17ab-4a59-bd82-466b65d01a68 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:46.860049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4bca5652-17ab-4a59-bd82-466b65d01a68 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:46.860960 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4bca5652-17ab-4a59-bd82-466b65d01a68 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:46.861591 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4bca5652-17ab-4a59-bd82-466b65d01a68 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:46.864551 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4bca5652-17ab-4a59-bd82-466b65d01a68 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:47.006793 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-4bca5652-17ab-4a59-bd82-466b65d01a68 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.168936 Sep 09 13:01:47.014970 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 300/597] 10.222.0.46 () {58 vars in 1275 bytes} [Fri Sep 9 13:01:46 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:01:47.214843 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-f5b8a843-a0dc-4cd0-88bd-60e0b62e29d9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:47.214843 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-f5b8a843-a0dc-4cd0-88bd-60e0b62e29d9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:47.214843 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f5b8a843-a0dc-4cd0-88bd-60e0b62e29d9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:47.214843 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f5b8a843-a0dc-4cd0-88bd-60e0b62e29d9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:47.215766 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f5b8a843-a0dc-4cd0-88bd-60e0b62e29d9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:47.215766 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f5b8a843-a0dc-4cd0-88bd-60e0b62e29d9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:47.215766 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f5b8a843-a0dc-4cd0-88bd-60e0b62e29d9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:47.215766 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f5b8a843-a0dc-4cd0-88bd-60e0b62e29d9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:47.624759 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-f5b8a843-a0dc-4cd0-88bd-60e0b62e29d9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:47.637003 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-f5b8a843-a0dc-4cd0-88bd-60e0b62e29d9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:47.641929 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-f5b8a843-a0dc-4cd0-88bd-60e0b62e29d9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:47.646692 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-f5b8a843-a0dc-4cd0-88bd-60e0b62e29d9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1736 microversion: 2.20 time: 0.509316 Sep 09 13:01:47.647060 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 298/598] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:47 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1736 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:01:48.673825 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-3ca75d2e-71e6-450b-a6ad-c03a78dd3ae0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:48.674535 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-3ca75d2e-71e6-450b-a6ad-c03a78dd3ae0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:48.680989 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3ca75d2e-71e6-450b-a6ad-c03a78dd3ae0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:48.681480 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3ca75d2e-71e6-450b-a6ad-c03a78dd3ae0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:48.681919 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3ca75d2e-71e6-450b-a6ad-c03a78dd3ae0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:48.682689 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3ca75d2e-71e6-450b-a6ad-c03a78dd3ae0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:48.683158 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3ca75d2e-71e6-450b-a6ad-c03a78dd3ae0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:48.683577 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3ca75d2e-71e6-450b-a6ad-c03a78dd3ae0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:48.820813 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-3ca75d2e-71e6-450b-a6ad-c03a78dd3ae0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:48.892535 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-3ca75d2e-71e6-450b-a6ad-c03a78dd3ae0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:48.892535 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-3ca75d2e-71e6-450b-a6ad-c03a78dd3ae0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:48.892535 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-3ca75d2e-71e6-450b-a6ad-c03a78dd3ae0 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1736 microversion: 2.20 time: 0.162979 Sep 09 13:01:48.892880 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 301/599] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:48 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:01:49.073574 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-83df6bab-0b68-4361-a867-07d5c57d3455 req-630c0656-e6b3-46c1-830f-a7e3ce408528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac5e13d7-1743-4f4a-9768-51f9b57e7811", "tag": "a0f07801-d4b2-4e0d-ad5d-be7c875c2cca"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:01:49.077575 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-23619b61-1512-483d-936c-75544b1c5178 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:49.083616 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-23619b61-1512-483d-936c-75544b1c5178 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:49.090471 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-23619b61-1512-483d-936c-75544b1c5178 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:49.094390 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-23619b61-1512-483d-936c-75544b1c5178 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:49.095335 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-23619b61-1512-483d-936c-75544b1c5178 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:49.097248 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-83df6bab-0b68-4361-a867-07d5c57d3455 req-630c0656-e6b3-46c1-830f-a7e3ce408528 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:49.098268 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-23619b61-1512-483d-936c-75544b1c5178 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:49.098924 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-23619b61-1512-483d-936c-75544b1c5178 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:49.104628 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-23619b61-1512-483d-936c-75544b1c5178 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:49.104761 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-83df6bab-0b68-4361-a867-07d5c57d3455 req-630c0656-e6b3-46c1-830f-a7e3ce408528 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:49.104761 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-83df6bab-0b68-4361-a867-07d5c57d3455 req-630c0656-e6b3-46c1-830f-a7e3ce408528 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:49.126084 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-83df6bab-0b68-4361-a867-07d5c57d3455 req-630c0656-e6b3-46c1-830f-a7e3ce408528 service nova] Creating event network-changed:a0f07801-d4b2-4e0d-ad5d-be7c875c2cca for instance ac5e13d7-1743-4f4a-9768-51f9b57e7811 on hv-cinder-81322 Sep 09 13:01:49.140217 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-83df6bab-0b68-4361-a867-07d5c57d3455 req-630c0656-e6b3-46c1-830f-a7e3ce408528 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070280 Sep 09 13:01:49.143544 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 302/600] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:01:49.219814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.objects.instance [None req-23619b61-1512-483d-936c-75544b1c5178 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lazy-loading 'services' on Instance uuid 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c {{(pid=127771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:01:49.475193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-23619b61-1512-483d-936c-75544b1c5178 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "DELETE /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c/os-volume_attachments/79aa33e7-6bdb-4491-bfd7-424cccb8315f" status: 202 len: 0 microversion: 2.1 time: 0.406579 Sep 09 13:01:49.486415 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-92b3982c-0470-456f-898c-c7e2ebbd2a8a tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:49.489013 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-92b3982c-0470-456f-898c-c7e2ebbd2a8a tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:49.489500 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 299/601] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 13:01:49 2022] DELETE /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c/os-volume_attachments/79aa33e7-6bdb-4491-bfd7-424cccb8315f => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:01:49.516043 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-92b3982c-0470-456f-898c-c7e2ebbd2a8a tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:49.516853 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-92b3982c-0470-456f-898c-c7e2ebbd2a8a tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:49.519954 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-92b3982c-0470-456f-898c-c7e2ebbd2a8a tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:49.522721 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-92b3982c-0470-456f-898c-c7e2ebbd2a8a tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:49.524251 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-92b3982c-0470-456f-898c-c7e2ebbd2a8a tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:49.524874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-92b3982c-0470-456f-898c-c7e2ebbd2a8a tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:49.598524 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-92b3982c-0470-456f-898c-c7e2ebbd2a8a tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117000 Sep 09 13:01:49.604148 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 303/602] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:01:49 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:01:49.858500 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-5c7812a9-eafb-4960-a936-c6139a73c20e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:49.859459 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-5c7812a9-eafb-4960-a936-c6139a73c20e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:49.869683 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5c7812a9-eafb-4960-a936-c6139a73c20e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:49.870450 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5c7812a9-eafb-4960-a936-c6139a73c20e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:49.871098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5c7812a9-eafb-4960-a936-c6139a73c20e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:49.871981 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5c7812a9-eafb-4960-a936-c6139a73c20e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:49.872654 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5c7812a9-eafb-4960-a936-c6139a73c20e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:49.873255 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5c7812a9-eafb-4960-a936-c6139a73c20e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:50.073312 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-5c7812a9-eafb-4960-a936-c6139a73c20e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:50.090517 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-5c7812a9-eafb-4960-a936-c6139a73c20e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:50.092028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-5c7812a9-eafb-4960-a936-c6139a73c20e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:50.093231 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-5c7812a9-eafb-4960-a936-c6139a73c20e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1736 microversion: 2.20 time: 0.239777 Sep 09 13:01:50.111971 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 300/603] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:49 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1736 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:01:50.614721 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-65977f17-d293-4c25-b50f-788fffd04467 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:50.621797 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-65977f17-d293-4c25-b50f-788fffd04467 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:50.634569 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-65977f17-d293-4c25-b50f-788fffd04467 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:50.635359 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-65977f17-d293-4c25-b50f-788fffd04467 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:50.635993 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-65977f17-d293-4c25-b50f-788fffd04467 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:50.636908 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-65977f17-d293-4c25-b50f-788fffd04467 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:50.638888 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-65977f17-d293-4c25-b50f-788fffd04467 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:50.639557 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-65977f17-d293-4c25-b50f-788fffd04467 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:50.718024 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-65977f17-d293-4c25-b50f-788fffd04467 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108815 Sep 09 13:01:50.732832 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 304/604] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:01:50 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:01:51.133375 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-4989875d-9c0e-4bae-aa10-4c2aee536ca2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:51.133984 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-4989875d-9c0e-4bae-aa10-4c2aee536ca2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:51.140438 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4989875d-9c0e-4bae-aa10-4c2aee536ca2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:51.141142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4989875d-9c0e-4bae-aa10-4c2aee536ca2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:51.141738 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4989875d-9c0e-4bae-aa10-4c2aee536ca2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:51.142623 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4989875d-9c0e-4bae-aa10-4c2aee536ca2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:51.143241 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4989875d-9c0e-4bae-aa10-4c2aee536ca2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:51.145823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4989875d-9c0e-4bae-aa10-4c2aee536ca2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:51.159382 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-d5a32435-b7e7-475c-a259-d17ab4edffed req-73869bda-7345-4e5c-ac6e-ea311cfc5de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c", "tag": "0f732f85-125a-41ad-8d5f-adfe587313de"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:01:51.171572 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-d5a32435-b7e7-475c-a259-d17ab4edffed req-73869bda-7345-4e5c-ac6e-ea311cfc5de0 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:51.172441 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-d5a32435-b7e7-475c-a259-d17ab4edffed req-73869bda-7345-4e5c-ac6e-ea311cfc5de0 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:51.173219 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-d5a32435-b7e7-475c-a259-d17ab4edffed req-73869bda-7345-4e5c-ac6e-ea311cfc5de0 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:51.207646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-d5a32435-b7e7-475c-a259-d17ab4edffed req-73869bda-7345-4e5c-ac6e-ea311cfc5de0 service nova] Creating event network-changed:0f732f85-125a-41ad-8d5f-adfe587313de for instance 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c on hv-cinder-81322 Sep 09 13:01:51.223695 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-d5a32435-b7e7-475c-a259-d17ab4edffed req-73869bda-7345-4e5c-ac6e-ea311cfc5de0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067739 Sep 09 13:01:51.224610 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 305/605] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:01:51.346282 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-4989875d-9c0e-4bae-aa10-4c2aee536ca2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:51.355699 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-4989875d-9c0e-4bae-aa10-4c2aee536ca2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:51.357589 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-4989875d-9c0e-4bae-aa10-4c2aee536ca2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:51.358956 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-4989875d-9c0e-4bae-aa10-4c2aee536ca2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1736 microversion: 2.20 time: 0.229627 Sep 09 13:01:51.359959 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 301/606] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:51 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:01:51.732450 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c26cc1c1-3ed6-4a0f-ad53-78ea2ea16028 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:51.736118 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-c26cc1c1-3ed6-4a0f-ad53-78ea2ea16028 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:51.743712 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c26cc1c1-3ed6-4a0f-ad53-78ea2ea16028 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:51.744499 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c26cc1c1-3ed6-4a0f-ad53-78ea2ea16028 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:51.745274 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c26cc1c1-3ed6-4a0f-ad53-78ea2ea16028 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:51.747091 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c26cc1c1-3ed6-4a0f-ad53-78ea2ea16028 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:51.748502 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c26cc1c1-3ed6-4a0f-ad53-78ea2ea16028 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:51.749251 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c26cc1c1-3ed6-4a0f-ad53-78ea2ea16028 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:51.797427 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-c26cc1c1-3ed6-4a0f-ad53-78ea2ea16028 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071019 Sep 09 13:01:51.798193 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 306/607] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:01:51 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 13:01:51.809645 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-7044f8ac-6327-40e0-b62e-3dfa67b4bd21 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:51.810671 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-7044f8ac-6327-40e0-b62e-3dfa67b4bd21 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:51.817743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7044f8ac-6327-40e0-b62e-3dfa67b4bd21 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:51.818245 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7044f8ac-6327-40e0-b62e-3dfa67b4bd21 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:51.818725 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7044f8ac-6327-40e0-b62e-3dfa67b4bd21 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:51.819442 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7044f8ac-6327-40e0-b62e-3dfa67b4bd21 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:51.819953 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7044f8ac-6327-40e0-b62e-3dfa67b4bd21 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:51.820463 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7044f8ac-6327-40e0-b62e-3dfa67b4bd21 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:51.910775 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-7044f8ac-6327-40e0-b62e-3dfa67b4bd21 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] HTTP exception thrown: Instance 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c is not attached to volume 79aa33e7-6bdb-4491-bfd7-424cccb8315f Sep 09 13:01:51.913219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-7044f8ac-6327-40e0-b62e-3dfa67b4bd21 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Request method failure captured: Sep 09 13:01:51.913219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: DELETE /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c/os-volume_attachments/79aa33e7-6bdb-4491-bfd7-424cccb8315f HTTP/1.1 Sep 09 13:01:51.913219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:01:51.913219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:01:51.913219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:01:51.913219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:01:51.913219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:01:51.913219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:01:51.913219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:01:51.913219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:01:51.913219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGziezvG1TWXoGNLRCOI-shd5i6EtnrwpWIRJvkHVyPVoZIaaNX9eAf7hEmQVD0s33byJz-6J539dRANsPha5w2Q-95yD_0BL4KroqtjjCunYuigYMBeQCdLN_qIAZWG9GHX9jvC1fDaQusODpanI4Etgp4sffHl8VQ7GiaMeUPUF6rg Sep 09 13:01:51.913219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:01:51.913219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:01:51.913219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:01:51.913219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:01:51.913219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:01:51.913219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:01:51.913219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: bfb3240493c84bda8102619400759342 Sep 09 13:01:51.913219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-TestMinimumBasicScenario-287690436 Sep 09 13:01:51.913219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:01:51.913219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:01:51.915401 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bfb3240493c84bda8102619400759342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bfb3240493c84bda8102619400759342", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bfb3240493c84bda8102619400759342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bfb3240493c84bda8102619400759342"}]}] Sep 09 13:01:51.915401 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-TestMinimumBasicScenario-287690436 Sep 09 13:01:51.915401 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: bfb3240493c84bda8102619400759342 Sep 09 13:01:51.915401 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-TestMinimumBasicScenario-287690436 Sep 09 13:01:51.915401 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-TestMinimumBasicScenario-287690436-project Sep 09 13:01:51.915401 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:01:51.915401 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:01:51.915401 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: eb144bc11f4b4cd59e1f70ebd6b7207c Sep 09 13:01:51.915401 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-TestMinimumBasicScenario-287690436-project Sep 09 13:01:51.915401 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:01:51.915401 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c is not attached to volume 79aa33e7-6bdb-4491-bfd7-424cccb8315f Sep 09 13:01:51.916236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'server_id': '13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c', 'id': '79aa33e7-6bdb-4491-bfd7-424cccb8315f'} Sep 09 13:01:51.916236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:01:51.916236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:01:51.916236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 09 13:01:51.916236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 09 13:01:51.916236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 13:01:51.916236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 13:01:51.916236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 09 13:01:51.916236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 09 13:01:51.916236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 79aa33e7-6bdb-4491-bfd7-424cccb8315f. Sep 09 13:01:51.916236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:01:51.916236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:01:51.916236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:01:51.916236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:01:51.916236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:01:51.916236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:01:51.916236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:01:51.916236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:01:51.916236 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:01:51.917872 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:01:51.917872 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 09 13:01:51.917872 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 09 13:01:51.917872 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c is not attached to volume 79aa33e7-6bdb-4491-bfd7-424cccb8315f Sep 09 13:01:51.917872 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:01:51.917872 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:01:51.917872 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:01:51.917872 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:01:51.917872 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:01:51.917872 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:01:51.917872 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:01:51.917872 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:01:51.917872 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c is not attached to volume 79aa33e7-6bdb-4491-bfd7-424cccb8315f Sep 09 13:01:51.917872 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:01:51.917872 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-7044f8ac-6327-40e0-b62e-3dfa67b4bd21 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Returning 404 to user: Instance 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c is not attached to volume 79aa33e7-6bdb-4491-bfd7-424cccb8315f {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:01:51.919832 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-7044f8ac-6327-40e0-b62e-3dfa67b4bd21 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "DELETE /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c/os-volume_attachments/79aa33e7-6bdb-4491-bfd7-424cccb8315f" status: 404 len: 154 microversion: 2.1 time: 0.110647 Sep 09 13:01:51.919832 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 302/608] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 13:01:51 2022] DELETE /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c/os-volume_attachments/79aa33e7-6bdb-4491-bfd7-424cccb8315f => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:01:52.386388 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ef6a35b3-0961-475a-8762-bcb69b6d6d15 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:52.391287 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-ef6a35b3-0961-475a-8762-bcb69b6d6d15 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:52.399721 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ef6a35b3-0961-475a-8762-bcb69b6d6d15 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:52.400213 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ef6a35b3-0961-475a-8762-bcb69b6d6d15 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:52.400683 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ef6a35b3-0961-475a-8762-bcb69b6d6d15 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:52.401411 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ef6a35b3-0961-475a-8762-bcb69b6d6d15 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:52.401864 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ef6a35b3-0961-475a-8762-bcb69b6d6d15 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:52.405891 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ef6a35b3-0961-475a-8762-bcb69b6d6d15 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:52.555117 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ef6a35b3-0961-475a-8762-bcb69b6d6d15 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:52.563780 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ef6a35b3-0961-475a-8762-bcb69b6d6d15 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:52.565499 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ef6a35b3-0961-475a-8762-bcb69b6d6d15 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:52.566824 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-ef6a35b3-0961-475a-8762-bcb69b6d6d15 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1736 microversion: 2.20 time: 0.185677 Sep 09 13:01:52.567396 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 307/609] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:52 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:01:53.222860 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a2eb3b0d-3757-4f73-9042-01b3702b1117 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:53.223385 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-a2eb3b0d-3757-4f73-9042-01b3702b1117 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:53.229851 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a2eb3b0d-3757-4f73-9042-01b3702b1117 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:53.230330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a2eb3b0d-3757-4f73-9042-01b3702b1117 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:53.230792 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a2eb3b0d-3757-4f73-9042-01b3702b1117 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:53.231483 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a2eb3b0d-3757-4f73-9042-01b3702b1117 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:53.231931 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a2eb3b0d-3757-4f73-9042-01b3702b1117 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:53.232354 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a2eb3b0d-3757-4f73-9042-01b3702b1117 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:53.259092 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-a2eb3b0d-3757-4f73-9042-01b3702b1117 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Going to try to terminate instance {{(pid=127771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:01:53.542429 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-a2eb3b0d-3757-4f73-9042-01b3702b1117 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "DELETE /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 204 len: 0 microversion: 2.1 time: 0.323083 Sep 09 13:01:53.546234 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 303/610] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:01:53 2022] DELETE /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:01:53.552908 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-5ac130bf-88c7-41de-963f-e88f32bdfa00 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:53.554282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-5ac130bf-88c7-41de-963f-e88f32bdfa00 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:53.560612 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5ac130bf-88c7-41de-963f-e88f32bdfa00 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:53.561216 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5ac130bf-88c7-41de-963f-e88f32bdfa00 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:53.561735 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5ac130bf-88c7-41de-963f-e88f32bdfa00 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:53.562374 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5ac130bf-88c7-41de-963f-e88f32bdfa00 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:53.562865 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5ac130bf-88c7-41de-963f-e88f32bdfa00 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:53.567836 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5ac130bf-88c7-41de-963f-e88f32bdfa00 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:53.585978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=100 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:01:53.594143 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-fc582109-24de-4173-aaaa-412827319586 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:53.597161 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-fc582109-24de-4173-aaaa-412827319586 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:53.602451 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fc582109-24de-4173-aaaa-412827319586 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:53.603156 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fc582109-24de-4173-aaaa-412827319586 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:53.603830 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fc582109-24de-4173-aaaa-412827319586 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:53.604791 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fc582109-24de-4173-aaaa-412827319586 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:53.605400 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fc582109-24de-4173-aaaa-412827319586 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:53.606112 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fc582109-24de-4173-aaaa-412827319586 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:53.720591 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-5ac130bf-88c7-41de-963f-e88f32bdfa00 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:53.729984 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-5ac130bf-88c7-41de-963f-e88f32bdfa00 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1554 microversion: 2.1 time: 0.182122 Sep 09 13:01:53.747526 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 308/611] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:53 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:01:53.756965 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-fc582109-24de-4173-aaaa-412827319586 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:53.765945 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-fc582109-24de-4173-aaaa-412827319586 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:53.767433 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-fc582109-24de-4173-aaaa-412827319586 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:53.768627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-fc582109-24de-4173-aaaa-412827319586 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1736 microversion: 2.20 time: 0.178949 Sep 09 13:01:53.769179 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 304/612] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:53 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:01:54.297419 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-5f75d942-103a-4782-b8c2-8b407f3c3fc8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:54.297918 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-5f75d942-103a-4782-b8c2-8b407f3c3fc8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:54.303965 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5f75d942-103a-4782-b8c2-8b407f3c3fc8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:54.306234 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5f75d942-103a-4782-b8c2-8b407f3c3fc8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:54.306234 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5f75d942-103a-4782-b8c2-8b407f3c3fc8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:54.307079 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5f75d942-103a-4782-b8c2-8b407f3c3fc8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:54.307548 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5f75d942-103a-4782-b8c2-8b407f3c3fc8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:54.307975 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5f75d942-103a-4782-b8c2-8b407f3c3fc8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:54.333654 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-5f75d942-103a-4782-b8c2-8b407f3c3fc8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Going to try to terminate instance {{(pid=127772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:01:54.577690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-5f75d942-103a-4782-b8c2-8b407f3c3fc8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 204 len: 0 microversion: 2.1 time: 0.283914 Sep 09 13:01:54.578378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 309/613] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:01:54 2022] DELETE /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:01:54.589128 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ed79adac-389d-4753-95d8-5d7f3ea67fac tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:54.589128 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ed79adac-389d-4753-95d8-5d7f3ea67fac tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:54.589970 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:01:54.596074 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ed79adac-389d-4753-95d8-5d7f3ea67fac tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:54.596567 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ed79adac-389d-4753-95d8-5d7f3ea67fac tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:54.597036 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ed79adac-389d-4753-95d8-5d7f3ea67fac tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:54.597746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ed79adac-389d-4753-95d8-5d7f3ea67fac tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:54.598320 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ed79adac-389d-4753-95d8-5d7f3ea67fac tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:54.599115 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ed79adac-389d-4753-95d8-5d7f3ea67fac tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:54.734612 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ed79adac-389d-4753-95d8-5d7f3ea67fac tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:54.743161 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ed79adac-389d-4753-95d8-5d7f3ea67fac tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1578 microversion: 2.1 time: 0.159863 Sep 09 13:01:54.743727 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 305/614] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:54 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:54.753655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-feb13d9b-c68b-482b-b16d-0f68484b3156 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:54.754602 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-feb13d9b-c68b-482b-b16d-0f68484b3156 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:54.760521 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-feb13d9b-c68b-482b-b16d-0f68484b3156 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:54.761002 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-feb13d9b-c68b-482b-b16d-0f68484b3156 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:54.761438 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-feb13d9b-c68b-482b-b16d-0f68484b3156 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:54.762126 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-feb13d9b-c68b-482b-b16d-0f68484b3156 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:54.762621 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-feb13d9b-c68b-482b-b16d-0f68484b3156 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:54.763045 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-feb13d9b-c68b-482b-b16d-0f68484b3156 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:54.794394 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e72759bc-ab87-45e7-a780-7c916380ae1f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:54.795036 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-e72759bc-ab87-45e7-a780-7c916380ae1f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:54.801252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e72759bc-ab87-45e7-a780-7c916380ae1f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:54.801810 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e72759bc-ab87-45e7-a780-7c916380ae1f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:54.802252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e72759bc-ab87-45e7-a780-7c916380ae1f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:54.802973 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e72759bc-ab87-45e7-a780-7c916380ae1f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:54.803419 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e72759bc-ab87-45e7-a780-7c916380ae1f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:54.803839 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e72759bc-ab87-45e7-a780-7c916380ae1f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:54.808508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:01:54.892813 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-feb13d9b-c68b-482b-b16d-0f68484b3156 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:54.901823 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-feb13d9b-c68b-482b-b16d-0f68484b3156 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1554 microversion: 2.1 time: 0.152363 Sep 09 13:01:54.902394 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 310/615] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:54 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:54.936051 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e72759bc-ab87-45e7-a780-7c916380ae1f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:54.944126 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e72759bc-ab87-45e7-a780-7c916380ae1f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:54.945678 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e72759bc-ab87-45e7-a780-7c916380ae1f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:54.946875 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-e72759bc-ab87-45e7-a780-7c916380ae1f tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1736 microversion: 2.20 time: 0.157619 Sep 09 13:01:54.947441 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 306/616] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:54 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:01:55.766763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-3b0b2b39-2dca-4754-996c-221d46578e9e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:55.767371 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-3b0b2b39-2dca-4754-996c-221d46578e9e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:55.773994 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3b0b2b39-2dca-4754-996c-221d46578e9e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:55.774515 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3b0b2b39-2dca-4754-996c-221d46578e9e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:55.775035 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3b0b2b39-2dca-4754-996c-221d46578e9e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:55.775736 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3b0b2b39-2dca-4754-996c-221d46578e9e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:55.776207 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3b0b2b39-2dca-4754-996c-221d46578e9e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:55.776642 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3b0b2b39-2dca-4754-996c-221d46578e9e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:55.907976 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-3b0b2b39-2dca-4754-996c-221d46578e9e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:55.916193 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-3b0b2b39-2dca-4754-996c-221d46578e9e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1578 microversion: 2.1 time: 0.152811 Sep 09 13:01:55.916759 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 311/617] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:55 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:55.925020 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-70bb39c1-f164-418d-94aa-744dfb6cf4f5 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:55.925629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-70bb39c1-f164-418d-94aa-744dfb6cf4f5 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:55.933131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-70bb39c1-f164-418d-94aa-744dfb6cf4f5 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:55.933946 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-70bb39c1-f164-418d-94aa-744dfb6cf4f5 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:55.934779 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-70bb39c1-f164-418d-94aa-744dfb6cf4f5 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:55.935957 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-70bb39c1-f164-418d-94aa-744dfb6cf4f5 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:55.936703 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-70bb39c1-f164-418d-94aa-744dfb6cf4f5 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:55.937383 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-70bb39c1-f164-418d-94aa-744dfb6cf4f5 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:55.972968 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-b4e92f67-a609-47a5-8e33-d89eb46d2801 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:55.973990 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-b4e92f67-a609-47a5-8e33-d89eb46d2801 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:55.980257 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b4e92f67-a609-47a5-8e33-d89eb46d2801 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:55.980750 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b4e92f67-a609-47a5-8e33-d89eb46d2801 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:55.981195 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b4e92f67-a609-47a5-8e33-d89eb46d2801 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:55.981905 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b4e92f67-a609-47a5-8e33-d89eb46d2801 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:55.982368 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b4e92f67-a609-47a5-8e33-d89eb46d2801 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:55.982842 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b4e92f67-a609-47a5-8e33-d89eb46d2801 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:56.074819 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-70bb39c1-f164-418d-94aa-744dfb6cf4f5 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:56.082849 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-70bb39c1-f164-418d-94aa-744dfb6cf4f5 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1554 microversion: 2.1 time: 0.161643 Sep 09 13:01:56.083419 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 307/618] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:55 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:56.113358 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-b4e92f67-a609-47a5-8e33-d89eb46d2801 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:56.122010 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-b4e92f67-a609-47a5-8e33-d89eb46d2801 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:56.123467 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-b4e92f67-a609-47a5-8e33-d89eb46d2801 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:56.124615 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-b4e92f67-a609-47a5-8e33-d89eb46d2801 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1736 microversion: 2.20 time: 0.155505 Sep 09 13:01:56.125256 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 312/619] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:55 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:01:56.939627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2c5ca37e-2ee2-45f0-94f9-32be706974a3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:56.940241 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2c5ca37e-2ee2-45f0-94f9-32be706974a3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:56.947036 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2c5ca37e-2ee2-45f0-94f9-32be706974a3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:56.947522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2c5ca37e-2ee2-45f0-94f9-32be706974a3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:56.947961 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2c5ca37e-2ee2-45f0-94f9-32be706974a3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:56.948656 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2c5ca37e-2ee2-45f0-94f9-32be706974a3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:56.949109 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2c5ca37e-2ee2-45f0-94f9-32be706974a3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:56.949535 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2c5ca37e-2ee2-45f0-94f9-32be706974a3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:57.090826 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2c5ca37e-2ee2-45f0-94f9-32be706974a3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:57.098823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2c5ca37e-2ee2-45f0-94f9-32be706974a3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1578 microversion: 2.1 time: 0.162882 Sep 09 13:01:57.099513 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 308/620] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:56 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:57.110583 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-9d323290-98ba-45c1-a237-5c5b0bab4b8c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:57.111207 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-9d323290-98ba-45c1-a237-5c5b0bab4b8c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:57.117271 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9d323290-98ba-45c1-a237-5c5b0bab4b8c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:57.117772 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9d323290-98ba-45c1-a237-5c5b0bab4b8c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:57.118213 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9d323290-98ba-45c1-a237-5c5b0bab4b8c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:57.119110 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9d323290-98ba-45c1-a237-5c5b0bab4b8c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:57.119579 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9d323290-98ba-45c1-a237-5c5b0bab4b8c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:57.120007 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9d323290-98ba-45c1-a237-5c5b0bab4b8c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:57.150749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-345209ed-f93c-4efb-9f07-9a52608c88e3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:57.151002 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-345209ed-f93c-4efb-9f07-9a52608c88e3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:57.157113 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-345209ed-f93c-4efb-9f07-9a52608c88e3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:57.157641 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-345209ed-f93c-4efb-9f07-9a52608c88e3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:57.158089 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-345209ed-f93c-4efb-9f07-9a52608c88e3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:57.158825 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-345209ed-f93c-4efb-9f07-9a52608c88e3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:57.159287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-345209ed-f93c-4efb-9f07-9a52608c88e3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:57.159715 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-345209ed-f93c-4efb-9f07-9a52608c88e3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:57.291335 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-345209ed-f93c-4efb-9f07-9a52608c88e3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:57.299538 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-345209ed-f93c-4efb-9f07-9a52608c88e3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:57.300994 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-345209ed-f93c-4efb-9f07-9a52608c88e3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:57.302162 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-345209ed-f93c-4efb-9f07-9a52608c88e3 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1718 microversion: 2.20 time: 0.156173 Sep 09 13:01:57.302798 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 309/621] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:57 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:01:57.564888 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-9d323290-98ba-45c1-a237-5c5b0bab4b8c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:57.572650 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-9d323290-98ba-45c1-a237-5c5b0bab4b8c tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1554 microversion: 2.1 time: 0.466210 Sep 09 13:01:57.573231 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 313/622] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:57 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1554 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:58.124584 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-dbd058c7-d53b-405e-9379-3ed5d47b40d6 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:58.125311 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-dbd058c7-d53b-405e-9379-3ed5d47b40d6 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:58.132413 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dbd058c7-d53b-405e-9379-3ed5d47b40d6 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:58.132958 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dbd058c7-d53b-405e-9379-3ed5d47b40d6 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:58.151078 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dbd058c7-d53b-405e-9379-3ed5d47b40d6 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:58.151078 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dbd058c7-d53b-405e-9379-3ed5d47b40d6 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:58.151078 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dbd058c7-d53b-405e-9379-3ed5d47b40d6 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:58.151078 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dbd058c7-d53b-405e-9379-3ed5d47b40d6 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:58.298979 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-dbd058c7-d53b-405e-9379-3ed5d47b40d6 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:58.307002 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-dbd058c7-d53b-405e-9379-3ed5d47b40d6 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1578 microversion: 2.1 time: 0.186806 Sep 09 13:01:58.307573 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 310/623] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:58 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1578 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:58.331594 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-db9c21cf-ae39-4bb9-a085-12b2947059dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:58.332870 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-db9c21cf-ae39-4bb9-a085-12b2947059dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:58.340124 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-db9c21cf-ae39-4bb9-a085-12b2947059dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:58.340682 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-db9c21cf-ae39-4bb9-a085-12b2947059dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:58.341187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-db9c21cf-ae39-4bb9-a085-12b2947059dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:58.341952 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-db9c21cf-ae39-4bb9-a085-12b2947059dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:58.342559 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-db9c21cf-ae39-4bb9-a085-12b2947059dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:58.343183 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-db9c21cf-ae39-4bb9-a085-12b2947059dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:58.482156 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-9fc15f50-3a96-4bc8-97cb-3996d1c85cb9 req-f98ec7bf-aa41-4a45-a905-1f664b20317b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c", "name": "network-vif-deleted", "tag": "0f732f85-125a-41ad-8d5f-adfe587313de"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:01:58.492104 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-9fc15f50-3a96-4bc8-97cb-3996d1c85cb9 req-f98ec7bf-aa41-4a45-a905-1f664b20317b service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:58.492591 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-9fc15f50-3a96-4bc8-97cb-3996d1c85cb9 req-f98ec7bf-aa41-4a45-a905-1f664b20317b service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:58.493027 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-9fc15f50-3a96-4bc8-97cb-3996d1c85cb9 req-f98ec7bf-aa41-4a45-a905-1f664b20317b service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:58.504660 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-9fc15f50-3a96-4bc8-97cb-3996d1c85cb9 req-f98ec7bf-aa41-4a45-a905-1f664b20317b service nova] Creating event network-vif-deleted:0f732f85-125a-41ad-8d5f-adfe587313de for instance 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c on hv-cinder-81322 Sep 09 13:01:58.510126 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-9fc15f50-3a96-4bc8-97cb-3996d1c85cb9 req-f98ec7bf-aa41-4a45-a905-1f664b20317b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089652 Sep 09 13:01:58.512015 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 311/624] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:01:58.547163 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-db9c21cf-ae39-4bb9-a085-12b2947059dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:58.555165 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-db9c21cf-ae39-4bb9-a085-12b2947059dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:58.557220 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-db9c21cf-ae39-4bb9-a085-12b2947059dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:58.558931 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-db9c21cf-ae39-4bb9-a085-12b2947059dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1718 microversion: 2.20 time: 0.231090 Sep 09 13:01:58.559491 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 314/625] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:58 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1718 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:01:58.597337 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ff8b6825-1783-43d2-bf5a-74d4c79a4c91 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:58.598716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ff8b6825-1783-43d2-bf5a-74d4c79a4c91 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:58.607173 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff8b6825-1783-43d2-bf5a-74d4c79a4c91 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:58.607599 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff8b6825-1783-43d2-bf5a-74d4c79a4c91 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:58.608032 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff8b6825-1783-43d2-bf5a-74d4c79a4c91 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:58.608714 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff8b6825-1783-43d2-bf5a-74d4c79a4c91 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:58.609165 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff8b6825-1783-43d2-bf5a-74d4c79a4c91 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:58.609653 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff8b6825-1783-43d2-bf5a-74d4c79a4c91 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:58.678822 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ff8b6825-1783-43d2-bf5a-74d4c79a4c91 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:58.689421 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ff8b6825-1783-43d2-bf5a-74d4c79a4c91 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1512 microversion: 2.1 time: 0.096478 Sep 09 13:01:58.689421 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 312/626] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:58 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1512 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:59.333401 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-73aa9683-b087-4581-adb6-c65a3c9202bf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:59.334141 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-73aa9683-b087-4581-adb6-c65a3c9202bf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:59.341098 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-73aa9683-b087-4581-adb6-c65a3c9202bf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:59.341672 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-73aa9683-b087-4581-adb6-c65a3c9202bf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:59.342112 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-73aa9683-b087-4581-adb6-c65a3c9202bf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:59.342968 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-73aa9683-b087-4581-adb6-c65a3c9202bf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:59.343277 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-73aa9683-b087-4581-adb6-c65a3c9202bf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:59.343702 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-73aa9683-b087-4581-adb6-c65a3c9202bf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:59.406373 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-73aa9683-b087-4581-adb6-c65a3c9202bf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:59.414074 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-73aa9683-b087-4581-adb6-c65a3c9202bf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1510 microversion: 2.1 time: 0.084773 Sep 09 13:01:59.414667 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 315/627] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:59 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1510 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:01:59.586915 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-6081275f-eef2-4be0-85c9-7a2d0d70d66e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:59.587815 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-6081275f-eef2-4be0-85c9-7a2d0d70d66e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:59.594231 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6081275f-eef2-4be0-85c9-7a2d0d70d66e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:59.594776 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6081275f-eef2-4be0-85c9-7a2d0d70d66e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:59.595212 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6081275f-eef2-4be0-85c9-7a2d0d70d66e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:59.595895 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6081275f-eef2-4be0-85c9-7a2d0d70d66e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:59.596347 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6081275f-eef2-4be0-85c9-7a2d0d70d66e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:59.596767 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6081275f-eef2-4be0-85c9-7a2d0d70d66e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:59.712469 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-4c60687b-a266-4019-b102-adf19d681dfb tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:01:59.713364 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-4c60687b-a266-4019-b102-adf19d681dfb tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:01:59.727011 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4c60687b-a266-4019-b102-adf19d681dfb tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:59.727512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4c60687b-a266-4019-b102-adf19d681dfb tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:59.727955 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4c60687b-a266-4019-b102-adf19d681dfb tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:59.729279 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4c60687b-a266-4019-b102-adf19d681dfb tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:01:59.729811 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4c60687b-a266-4019-b102-adf19d681dfb tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:01:59.730251 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4c60687b-a266-4019-b102-adf19d681dfb tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:01:59.730987 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-6081275f-eef2-4be0-85c9-7a2d0d70d66e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:59.740812 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-6081275f-eef2-4be0-85c9-7a2d0d70d66e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:59.740975 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-6081275f-eef2-4be0-85c9-7a2d0d70d66e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:59.742426 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-6081275f-eef2-4be0-85c9-7a2d0d70d66e tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1718 microversion: 2.20 time: 0.159878 Sep 09 13:01:59.743112 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 313/628] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:01:59 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1718 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:01:59.794381 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-4c60687b-a266-4019-b102-adf19d681dfb tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:01:59.802533 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-4c60687b-a266-4019-b102-adf19d681dfb tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1512 microversion: 2.1 time: 0.093873 Sep 09 13:01:59.803166 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 316/629] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:01:59 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1512 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:02:00.437482 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d84564e8-736d-47e7-9618-225f7cb30fb2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:00.439889 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-d84564e8-736d-47e7-9618-225f7cb30fb2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:00.444352 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d84564e8-736d-47e7-9618-225f7cb30fb2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:00.444843 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d84564e8-736d-47e7-9618-225f7cb30fb2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:00.445307 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d84564e8-736d-47e7-9618-225f7cb30fb2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:00.446008 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d84564e8-736d-47e7-9618-225f7cb30fb2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:00.446468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d84564e8-736d-47e7-9618-225f7cb30fb2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:00.446920 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d84564e8-736d-47e7-9618-225f7cb30fb2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:00.515997 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-d84564e8-736d-47e7-9618-225f7cb30fb2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:00.524133 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d84564e8-736d-47e7-9618-225f7cb30fb2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1225 microversion: 2.1 time: 0.090494 Sep 09 13:02:00.524987 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 314/630] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:00 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:00.528951 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-d8d5308f-80b2-4554-81fb-de73acb22d4d req-d9fc0c25-b940-45fd-b8ad-78a1236273a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87", "name": "network-vif-deleted", "tag": "cded5ff7-f97f-40e2-a004-1b7adc01e3da"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:02:00.539048 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-d8d5308f-80b2-4554-81fb-de73acb22d4d req-d9fc0c25-b940-45fd-b8ad-78a1236273a3 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:00.539523 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-d8d5308f-80b2-4554-81fb-de73acb22d4d req-d9fc0c25-b940-45fd-b8ad-78a1236273a3 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:00.539945 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-d8d5308f-80b2-4554-81fb-de73acb22d4d req-d9fc0c25-b940-45fd-b8ad-78a1236273a3 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:00.551381 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-d8d5308f-80b2-4554-81fb-de73acb22d4d req-d9fc0c25-b940-45fd-b8ad-78a1236273a3 service nova] Creating event network-vif-deleted:cded5ff7-f97f-40e2-a004-1b7adc01e3da for instance c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 on hv-cinder-81322 Sep 09 13:02:00.556349 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-d8d5308f-80b2-4554-81fb-de73acb22d4d req-d9fc0c25-b940-45fd-b8ad-78a1236273a3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032742 Sep 09 13:02:00.557081 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 317/631] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:02:00.627914 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-1e589c06-9b6a-4701-b52d-6323b44d7b52 req-500d7660-d674-4b45-8f88-dbd734ea71b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37305bac-ecac-4f89-a340-55d5ffc7a775", "name": "network-vif-unplugged", "status": "completed", "tag": "10813693-1d59-4806-bfad-10fa8cfeba3b"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:02:00.638446 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-1e589c06-9b6a-4701-b52d-6323b44d7b52 req-500d7660-d674-4b45-8f88-dbd734ea71b7 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:00.639059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-1e589c06-9b6a-4701-b52d-6323b44d7b52 req-500d7660-d674-4b45-8f88-dbd734ea71b7 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:00.639489 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-1e589c06-9b6a-4701-b52d-6323b44d7b52 req-500d7660-d674-4b45-8f88-dbd734ea71b7 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:00.650687 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-1e589c06-9b6a-4701-b52d-6323b44d7b52 req-500d7660-d674-4b45-8f88-dbd734ea71b7 service nova] Creating event network-vif-unplugged:10813693-1d59-4806-bfad-10fa8cfeba3b for instance 37305bac-ecac-4f89-a340-55d5ffc7a775 on hv-cinder-81322 Sep 09 13:02:00.657329 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-1e589c06-9b6a-4701-b52d-6323b44d7b52 req-500d7660-d674-4b45-8f88-dbd734ea71b7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033082 Sep 09 13:02:00.657954 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 315/632] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:02:00.768978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a59b3052-ba12-4d45-887c-681f364da3e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:00.769794 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a59b3052-ba12-4d45-887c-681f364da3e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:00.780107 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a59b3052-ba12-4d45-887c-681f364da3e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:00.780107 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a59b3052-ba12-4d45-887c-681f364da3e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:00.780107 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a59b3052-ba12-4d45-887c-681f364da3e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:00.780107 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a59b3052-ba12-4d45-887c-681f364da3e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:00.780592 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a59b3052-ba12-4d45-887c-681f364da3e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:00.780592 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a59b3052-ba12-4d45-887c-681f364da3e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:00.828579 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-1921377d-7623-4240-b612-f9ed3a7c46fe tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:00.831676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-1921377d-7623-4240-b612-f9ed3a7c46fe tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:00.836195 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1921377d-7623-4240-b612-f9ed3a7c46fe tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:00.837034 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1921377d-7623-4240-b612-f9ed3a7c46fe tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:00.838035 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1921377d-7623-4240-b612-f9ed3a7c46fe tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:00.839395 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1921377d-7623-4240-b612-f9ed3a7c46fe tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:00.839509 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1921377d-7623-4240-b612-f9ed3a7c46fe tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:00.839911 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1921377d-7623-4240-b612-f9ed3a7c46fe tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:00.875996 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1921377d-7623-4240-b612-f9ed3a7c46fe tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:00.876763 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1921377d-7623-4240-b612-f9ed3a7c46fe tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:00.877217 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1921377d-7623-4240-b612-f9ed3a7c46fe tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:00.877693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.objects.instance [None req-1921377d-7623-4240-b612-f9ed3a7c46fe tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lazy-loading 'fault' on Instance uuid 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c {{(pid=127771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:02:00.921566 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a59b3052-ba12-4d45-887c-681f364da3e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:00.933317 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a59b3052-ba12-4d45-887c-681f364da3e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:00.935097 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a59b3052-ba12-4d45-887c-681f364da3e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:00.936342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a59b3052-ba12-4d45-887c-681f364da3e2 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1721 microversion: 2.20 time: 0.171657 Sep 09 13:02:00.936513 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-1921377d-7623-4240-b612-f9ed3a7c46fe tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb144bc11f4b4cd59e1f70ebd6b7207c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb3240493c84bda8102619400759342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:00.937738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 318/633] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:02:00 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:02:00.963938 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-23dc6cf8-0ff3-4f6f-b2a1-4d060c3d2302 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "847362a6-2d9c-4d5e-a2e5-d43db620dbdd"}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:02:00.965934 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-1921377d-7623-4240-b612-f9ed3a7c46fe tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 200 len: 1348 microversion: 2.1 time: 0.142034 Sep 09 13:02:00.966308 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-23dc6cf8-0ff3-4f6f-b2a1-4d060c3d2302 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:00.972268 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-23dc6cf8-0ff3-4f6f-b2a1-4d060c3d2302 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:00.972760 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-23dc6cf8-0ff3-4f6f-b2a1-4d060c3d2302 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:00.973194 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-23dc6cf8-0ff3-4f6f-b2a1-4d060c3d2302 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:00.973886 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-23dc6cf8-0ff3-4f6f-b2a1-4d060c3d2302 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:00.974341 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-23dc6cf8-0ff3-4f6f-b2a1-4d060c3d2302 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:00.974786 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-23dc6cf8-0ff3-4f6f-b2a1-4d060c3d2302 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:00.983499 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 316/634] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:00 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 1348 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:02:01.546786 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-cd5c487c-a806-4f59-b7c1-000555b8f309 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:01.547423 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-cd5c487c-a806-4f59-b7c1-000555b8f309 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:01.553410 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cd5c487c-a806-4f59-b7c1-000555b8f309 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:01.553921 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cd5c487c-a806-4f59-b7c1-000555b8f309 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:01.554256 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cd5c487c-a806-4f59-b7c1-000555b8f309 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:01.554965 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cd5c487c-a806-4f59-b7c1-000555b8f309 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:01.555416 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cd5c487c-a806-4f59-b7c1-000555b8f309 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:01.555836 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cd5c487c-a806-4f59-b7c1-000555b8f309 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:01.587775 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cd5c487c-a806-4f59-b7c1-000555b8f309 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:01.588255 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cd5c487c-a806-4f59-b7c1-000555b8f309 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:01.588875 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cd5c487c-a806-4f59-b7c1-000555b8f309 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:01.589320 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.objects.instance [None req-cd5c487c-a806-4f59-b7c1-000555b8f309 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lazy-loading 'fault' on Instance uuid c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 {{(pid=127771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:02:01.629942 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-cd5c487c-a806-4f59-b7c1-000555b8f309 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:01.638190 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-cd5c487c-a806-4f59-b7c1-000555b8f309 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 200 len: 1230 microversion: 2.1 time: 0.095142 Sep 09 13:02:01.638793 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 317/635] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:01 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:02:01.942717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-23dc6cf8-0ff3-4f6f-b2a1-4d060c3d2302 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "POST /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.983655 Sep 09 13:02:01.943318 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 319/636] 10.222.0.46 () {62 vars in 1364 bytes} [Fri Sep 9 13:02:00 2022] POST /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775/os-volume_attachments => generated 188 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 13:02:01.993356 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-22a3ae1d-d8a4-4e62-84d1-86f6393be68d tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:01.993968 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-22a3ae1d-d8a4-4e62-84d1-86f6393be68d tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] [instance: 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:02.010755 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-22a3ae1d-d8a4-4e62-84d1-86f6393be68d tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:02.010755 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-22a3ae1d-d8a4-4e62-84d1-86f6393be68d tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:02.010755 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-22a3ae1d-d8a4-4e62-84d1-86f6393be68d tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:02.010755 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-22a3ae1d-d8a4-4e62-84d1-86f6393be68d tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:02.011160 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-22a3ae1d-d8a4-4e62-84d1-86f6393be68d tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:02.011160 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-22a3ae1d-d8a4-4e62-84d1-86f6393be68d tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:02.018047 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-22a3ae1d-d8a4-4e62-84d1-86f6393be68d tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] HTTP exception thrown: Instance 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c could not be found. Sep 09 13:02:02.019749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-22a3ae1d-d8a4-4e62-84d1-86f6393be68d tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Request method failure captured: Sep 09 13:02:02.019749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c HTTP/1.1 Sep 09 13:02:02.019749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:02:02.019749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:02:02.019749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:02:02.019749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:02:02.019749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:02:02.019749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:02:02.019749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:02:02.019749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:02:02.019749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGziezvG1TWXoGNLRCOI-shd5i6EtnrwpWIRJvkHVyPVoZIaaNX9eAf7hEmQVD0s33byJz-6J539dRANsPha5w2Q-95yD_0BL4KroqtjjCunYuigYMBeQCdLN_qIAZWG9GHX9jvC1fDaQusODpanI4Etgp4sffHl8VQ7GiaMeUPUF6rg Sep 09 13:02:02.019749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:02:02.019749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:02:02.019749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:02:02.019749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:02:02.019749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:02:02.019749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:02:02.019749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: bfb3240493c84bda8102619400759342 Sep 09 13:02:02.019749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-TestMinimumBasicScenario-287690436 Sep 09 13:02:02.019749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:02:02.019749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:02:02.021350 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bfb3240493c84bda8102619400759342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bfb3240493c84bda8102619400759342", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bfb3240493c84bda8102619400759342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bfb3240493c84bda8102619400759342"}]}] Sep 09 13:02:02.021350 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-TestMinimumBasicScenario-287690436 Sep 09 13:02:02.021350 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: bfb3240493c84bda8102619400759342 Sep 09 13:02:02.021350 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-TestMinimumBasicScenario-287690436 Sep 09 13:02:02.021350 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-TestMinimumBasicScenario-287690436-project Sep 09 13:02:02.021350 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:02:02.021350 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:02:02.021350 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: eb144bc11f4b4cd59e1f70ebd6b7207c Sep 09 13:02:02.021350 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-TestMinimumBasicScenario-287690436-project Sep 09 13:02:02.021350 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:02:02.021350 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c could not be found. Sep 09 13:02:02.021350 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': '13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c'} Sep 09 13:02:02.022606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:02:02.022606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:02.022606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:02:02.022606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:02:02.022606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:02:02.022606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:02:02.022606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:02:02.022606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:02:02.022606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:02:02.022606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:02:02.022606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c could not be found. Sep 09 13:02:02.022606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:02.022606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:02.022606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:02.022606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:02.022606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:02.022606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:02.022606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:02:02.022606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:02:02.022606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:02:02.024259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:02:02.024259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:02:02.024259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:02:02.024259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:02:02.024259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:02:02.024259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:02:02.024259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:02:02.024259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c could not be found. Sep 09 13:02:02.024259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:02.024259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:02.024259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:02.024259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:02.024259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:02.024259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:02.024259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:02:02.024259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:02:02.024259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c could not be found. Sep 09 13:02:02.024259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:02.028396 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-22a3ae1d-d8a4-4e62-84d1-86f6393be68d tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Returning 404 to user: Instance 13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:02:02.028396 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-22a3ae1d-d8a4-4e62-84d1-86f6393be68d tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c" status: 404 len: 111 microversion: 2.1 time: 0.031736 Sep 09 13:02:02.031123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-1d03a830-3a0d-4a2a-b106-a8269d050ed6 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] Calling method '.version_select at 0x7f31830f7b80>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:02.035940 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 318/637] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:01 2022] GET /compute/v2.1/servers/13e6d3ce-40a8-4c9e-8372-3380ac0bbb1c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:02:02.084477 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-47997c5d-4cf4-4121-afe0-fb4d08e66270 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:02.084994 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-47997c5d-4cf4-4121-afe0-fb4d08e66270 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:02.091591 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47997c5d-4cf4-4121-afe0-fb4d08e66270 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:02.092076 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47997c5d-4cf4-4121-afe0-fb4d08e66270 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:02.092508 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47997c5d-4cf4-4121-afe0-fb4d08e66270 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:02.093188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47997c5d-4cf4-4121-afe0-fb4d08e66270 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:02.093639 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47997c5d-4cf4-4121-afe0-fb4d08e66270 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:02.094062 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47997c5d-4cf4-4121-afe0-fb4d08e66270 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:02.124459 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-1d03a830-3a0d-4a2a-b106-a8269d050ed6 tempest-TestMinimumBasicScenario-287690436 tempest-TestMinimumBasicScenario-287690436-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-284832017" status: 202 len: 0 microversion: 2.1 time: 0.097738 Sep 09 13:02:02.125024 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 320/638] 10.222.0.46 () {58 vars in 1269 bytes} [Fri Sep 9 13:02:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-284832017 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:02:02.661781 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-15e8eaa1-aa52-43fb-9af2-8eef2ea77001 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:02.662391 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-15e8eaa1-aa52-43fb-9af2-8eef2ea77001 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:02.669481 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-15e8eaa1-aa52-43fb-9af2-8eef2ea77001 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:02.669960 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-15e8eaa1-aa52-43fb-9af2-8eef2ea77001 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:02.672301 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-15e8eaa1-aa52-43fb-9af2-8eef2ea77001 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:02.672301 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-15e8eaa1-aa52-43fb-9af2-8eef2ea77001 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:02.672301 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-15e8eaa1-aa52-43fb-9af2-8eef2ea77001 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:02.672301 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-15e8eaa1-aa52-43fb-9af2-8eef2ea77001 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:02.685962 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-15e8eaa1-aa52-43fb-9af2-8eef2ea77001 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] HTTP exception thrown: Instance c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 could not be found. Sep 09 13:02:02.687605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-15e8eaa1-aa52-43fb-9af2-8eef2ea77001 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Request method failure captured: Sep 09 13:02:02.687605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 HTTP/1.1 Sep 09 13:02:02.687605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 13:02:02.687605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 13:02:02.687605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 13:02:02.687605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 13:02:02.687605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 13:02:02.687605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 13:02:02.687605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 13:02:02.687605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 13:02:02.687605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGziBp0TaRLVpJdvMiJoN5D3Evvin9QSbVm_yv3jhPeMQtBMG8G_NILBFPo_KFyNseqTRGO2R_1FlOV7avlgPxGwpBN-SPbr84YKCS2rLKsGdRwGlmBOnz8geOjbljkzC_ct6cP6NFHtKzPG0fVBpGHwLALPrywi42LSTd9vtyqG6ZR4 Sep 09 13:02:02.687605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 13:02:02.687605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 13:02:02.687605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 13:02:02.687605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 13:02:02.687605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 13:02:02.687605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 13:02:02.687605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: d427be7da6084e009b87ff500858cdc8 Sep 09 13:02:02.687605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-TestVolumeBootPattern-956018443 Sep 09 13:02:02.687605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 13:02:02.687605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 13:02:02.689206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d427be7da6084e009b87ff500858cdc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d427be7da6084e009b87ff500858cdc8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d427be7da6084e009b87ff500858cdc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d427be7da6084e009b87ff500858cdc8"}]}] Sep 09 13:02:02.689206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-TestVolumeBootPattern-956018443 Sep 09 13:02:02.689206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: d427be7da6084e009b87ff500858cdc8 Sep 09 13:02:02.689206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-TestVolumeBootPattern-956018443 Sep 09 13:02:02.689206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-TestVolumeBootPattern-956018443-project Sep 09 13:02:02.689206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 13:02:02.689206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 13:02:02.689206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: 4c96322c48c146c7b8bcb9959f533820 Sep 09 13:02:02.689206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-TestVolumeBootPattern-956018443-project Sep 09 13:02:02.689206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: > Sep 09 13:02:02.689206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Instance c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 could not be found. Sep 09 13:02:02.689206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'id': 'c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87'} Sep 09 13:02:02.690196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:02:02.690196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:02.690196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:02:02.690196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:02:02.690196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:02:02.690196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:02:02.690196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:02:02.690196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:02:02.690196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:02:02.690196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:02:02.690196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 could not be found. Sep 09 13:02:02.690196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:02:02.690196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:02.690196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:02:02.690196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:02.690196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:02.690196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:02.690196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:02:02.690196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:02:02.690196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:02:02.691800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:02:02.691800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:02:02.691800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:02:02.691800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:02:02.691800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:02:02.691800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:02:02.691800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:02:02.691800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 could not be found. Sep 09 13:02:02.691800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:02:02.691800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:02.691800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:02:02.691800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:02.691800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:02.691800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:02.691800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:02:02.691800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:02:02.691800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 could not be found. Sep 09 13:02:02.691800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:02:02.693078 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-15e8eaa1-aa52-43fb-9af2-8eef2ea77001 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Returning 404 to user: Instance c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:02:02.693078 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-15e8eaa1-aa52-43fb-9af2-8eef2ea77001 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 404 len: 111 microversion: 2.1 time: 0.031829 Sep 09 13:02:02.693078 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 321/639] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:02 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 13:02:02.738568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a6fad012-e331-4ab5-bb94-87635cf3911f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2083123650", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1884139847", "security_groups": [{"name": "tempest-secgroup-smoke-2064900932"}], "block_device_mapping_v2": [{"uuid": "68cf983a-c27b-40bd-aba1-594695621de8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bc9bf6c8-7de3-464c-a549-1b7488b07c6e"}]}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:02:02.770938 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-47997c5d-4cf4-4121-afe0-fb4d08e66270 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "DELETE /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775/os-volume_attachments/847362a6-2d9c-4d5e-a2e5-d43db620dbdd" status: 202 len: 0 microversion: 2.20 time: 0.690626 Sep 09 13:02:02.782212 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 319/640] 10.222.0.46 () {60 vars in 1457 bytes} [Fri Sep 9 13:02:02 2022] DELETE /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775/os-volume_attachments/847362a6-2d9c-4d5e-a2e5-d43db620dbdd => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 09 13:02:02.834248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-be1e8d5c-40af-409e-91a3-f5db0804c7f9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:02:02.834892 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-be1e8d5c-40af-409e-91a3-f5db0804c7f9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:02.841094 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-be1e8d5c-40af-409e-91a3-f5db0804c7f9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:02.841719 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-be1e8d5c-40af-409e-91a3-f5db0804c7f9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:02.842234 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-be1e8d5c-40af-409e-91a3-f5db0804c7f9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:02.842914 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-be1e8d5c-40af-409e-91a3-f5db0804c7f9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:02.843376 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-be1e8d5c-40af-409e-91a3-f5db0804c7f9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:02.843815 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-be1e8d5c-40af-409e-91a3-f5db0804c7f9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:02.860162 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.network.neutron [None req-a6fad012-e331-4ab5-bb94-87635cf3911f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] validate_networks() for [('bc9bf6c8-7de3-464c-a549-1b7488b07c6e', None, None, None, None, None)] {{(pid=127772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:02:02.875167 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-be1e8d5c-40af-409e-91a3-f5db0804c7f9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127771) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 13:02:02.987869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:02:03.143999 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-be1e8d5c-40af-409e-91a3-f5db0804c7f9 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "POST /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775/action" status: 202 len: 0 microversion: 2.20 time: 0.313994 Sep 09 13:02:03.144783 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 320/641] 10.222.0.46 () {62 vars in 1319 bytes} [Fri Sep 9 13:02:02 2022] POST /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:02:03.153612 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-31bd6c75-fc02-4080-a459-da0b038ac465 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:03.154457 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-31bd6c75-fc02-4080-a459-da0b038ac465 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:03.160737 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31bd6c75-fc02-4080-a459-da0b038ac465 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:03.161251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31bd6c75-fc02-4080-a459-da0b038ac465 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:03.161720 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31bd6c75-fc02-4080-a459-da0b038ac465 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:03.162395 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31bd6c75-fc02-4080-a459-da0b038ac465 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:03.162914 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31bd6c75-fc02-4080-a459-da0b038ac465 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:03.167791 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31bd6c75-fc02-4080-a459-da0b038ac465 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:03.316034 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-31bd6c75-fc02-4080-a459-da0b038ac465 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:03.324867 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-31bd6c75-fc02-4080-a459-da0b038ac465 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:03.326815 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-31bd6c75-fc02-4080-a459-da0b038ac465 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:03.328015 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-31bd6c75-fc02-4080-a459-da0b038ac465 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1669 microversion: 2.20 time: 0.179101 Sep 09 13:02:03.328576 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 321/642] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:02:03 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1669 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:02:03.342036 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-a6fad012-e331-4ab5-bb94-87635cf3911f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Flavor limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:02:03.342036 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-a6fad012-e331-4ab5-bb94-87635cf3911f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Image limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:02:03.342036 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-a6fad012-e331-4ab5-bb94-87635cf3911f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Flavor pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:02:03.342036 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-a6fad012-e331-4ab5-bb94-87635cf3911f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Image pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:02:03.342036 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-a6fad012-e331-4ab5-bb94-87635cf3911f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:02:03.349159 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a6fad012-e331-4ab5-bb94-87635cf3911f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:03.349647 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a6fad012-e331-4ab5-bb94-87635cf3911f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:03.350092 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a6fad012-e331-4ab5-bb94-87635cf3911f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:03.350871 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a6fad012-e331-4ab5-bb94-87635cf3911f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:03.351398 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a6fad012-e331-4ab5-bb94-87635cf3911f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:03.351824 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a6fad012-e331-4ab5-bb94-87635cf3911f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:03.371658 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-a6fad012-e331-4ab5-bb94-87635cf3911f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Getting quotas for project d427be7da6084e009b87ff500858cdc8. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:02:03.375921 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-a6fad012-e331-4ab5-bb94-87635cf3911f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Getting quotas for user 4c96322c48c146c7b8bcb9959f533820 and project d427be7da6084e009b87ff500858cdc8. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:02:03.440876 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a6fad012-e331-4ab5-bb94-87635cf3911f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Going to run 1 instances... {{(pid=127772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:02:03.443155 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a6fad012-e331-4ab5-bb94-87635cf3911f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68cf983a-c27b-40bd-aba1-594695621de8',volume_size=None,volume_type=None)] {{(pid=127772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:02:03.834287 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a6fad012-e331-4ab5-bb94-87635cf3911f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.099234 Sep 09 13:02:03.834287 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 322/643] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 13:02:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 13:02:03.846930 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-292fb34c-5060-41c5-a277-9eb0053ccb3d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:03.848831 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-292fb34c-5060-41c5-a277-9eb0053ccb3d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:04.191047 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-292fb34c-5060-41c5-a277-9eb0053ccb3d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:04.198376 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-292fb34c-5060-41c5-a277-9eb0053ccb3d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1095 microversion: 2.1 time: 0.355589 Sep 09 13:02:04.198977 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 322/644] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:03 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1095 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:04.356781 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ad63b7f7-f528-46cd-9179-159ac843c3bd tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:04.357395 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-ad63b7f7-f528-46cd-9179-159ac843c3bd tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:04.363800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ad63b7f7-f528-46cd-9179-159ac843c3bd tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:04.364275 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ad63b7f7-f528-46cd-9179-159ac843c3bd tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:04.364704 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ad63b7f7-f528-46cd-9179-159ac843c3bd tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:04.365396 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ad63b7f7-f528-46cd-9179-159ac843c3bd tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:04.365871 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ad63b7f7-f528-46cd-9179-159ac843c3bd tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:04.366293 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ad63b7f7-f528-46cd-9179-159ac843c3bd tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:04.520187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ad63b7f7-f528-46cd-9179-159ac843c3bd tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:04.524121 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:02:04.530349 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ad63b7f7-f528-46cd-9179-159ac843c3bd tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:04.531993 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ad63b7f7-f528-46cd-9179-159ac843c3bd tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:04.533165 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-ad63b7f7-f528-46cd-9179-159ac843c3bd tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1669 microversion: 2.20 time: 0.181324 Sep 09 13:02:04.533712 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 323/645] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:02:04 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1669 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:02:05.222131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-57738d47-2279-4acb-8c52-0dcdc1181590 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:05.223746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-57738d47-2279-4acb-8c52-0dcdc1181590 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:05.236468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-57738d47-2279-4acb-8c52-0dcdc1181590 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:05.236468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-57738d47-2279-4acb-8c52-0dcdc1181590 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:05.238321 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-57738d47-2279-4acb-8c52-0dcdc1181590 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:05.239070 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-57738d47-2279-4acb-8c52-0dcdc1181590 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:05.239537 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-57738d47-2279-4acb-8c52-0dcdc1181590 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:05.239969 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-57738d47-2279-4acb-8c52-0dcdc1181590 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:05.349122 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-57738d47-2279-4acb-8c52-0dcdc1181590 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:05.359623 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-57738d47-2279-4acb-8c52-0dcdc1181590 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1137 microversion: 2.1 time: 0.141611 Sep 09 13:02:05.360357 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 323/646] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:05 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1137 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:05.558972 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-f9a17705-79ee-4e8e-988c-d2a1e74365dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:05.560135 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-f9a17705-79ee-4e8e-988c-d2a1e74365dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:05.564080 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:02:05.569759 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f9a17705-79ee-4e8e-988c-d2a1e74365dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:05.570761 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f9a17705-79ee-4e8e-988c-d2a1e74365dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:05.571259 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f9a17705-79ee-4e8e-988c-d2a1e74365dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:05.571984 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f9a17705-79ee-4e8e-988c-d2a1e74365dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:05.572973 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f9a17705-79ee-4e8e-988c-d2a1e74365dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:05.573591 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f9a17705-79ee-4e8e-988c-d2a1e74365dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:05.792686 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-f9a17705-79ee-4e8e-988c-d2a1e74365dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:05.800817 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-f9a17705-79ee-4e8e-988c-d2a1e74365dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:05.802342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-f9a17705-79ee-4e8e-988c-d2a1e74365dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:05.803632 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-f9a17705-79ee-4e8e-988c-d2a1e74365dc tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1727 microversion: 2.20 time: 0.248949 Sep 09 13:02:05.804267 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 324/647] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:02:05 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1727 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:02:06.383351 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2dbe6b5c-6617-4ed2-bf6a-e94d909df06f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:06.383966 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2dbe6b5c-6617-4ed2-bf6a-e94d909df06f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:06.391178 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2dbe6b5c-6617-4ed2-bf6a-e94d909df06f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:06.391742 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2dbe6b5c-6617-4ed2-bf6a-e94d909df06f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:06.392187 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2dbe6b5c-6617-4ed2-bf6a-e94d909df06f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:06.392877 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2dbe6b5c-6617-4ed2-bf6a-e94d909df06f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:06.393330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2dbe6b5c-6617-4ed2-bf6a-e94d909df06f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:06.393752 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2dbe6b5c-6617-4ed2-bf6a-e94d909df06f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:06.461443 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2dbe6b5c-6617-4ed2-bf6a-e94d909df06f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:06.472069 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2dbe6b5c-6617-4ed2-bf6a-e94d909df06f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1193 microversion: 2.1 time: 0.092474 Sep 09 13:02:06.481958 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 324/648] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:06 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1193 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:06.832986 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7a97ebcd-b183-4f39-9c97-f0fdfcb7c811 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:06.833509 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7a97ebcd-b183-4f39-9c97-f0fdfcb7c811 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:06.840339 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a97ebcd-b183-4f39-9c97-f0fdfcb7c811 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:06.840824 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a97ebcd-b183-4f39-9c97-f0fdfcb7c811 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:06.841281 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a97ebcd-b183-4f39-9c97-f0fdfcb7c811 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:06.841961 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a97ebcd-b183-4f39-9c97-f0fdfcb7c811 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:06.842419 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a97ebcd-b183-4f39-9c97-f0fdfcb7c811 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:06.842897 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a97ebcd-b183-4f39-9c97-f0fdfcb7c811 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:07.148128 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7a97ebcd-b183-4f39-9c97-f0fdfcb7c811 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:07.160127 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7a97ebcd-b183-4f39-9c97-f0fdfcb7c811 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:07.163240 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7a97ebcd-b183-4f39-9c97-f0fdfcb7c811 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:07.164991 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7a97ebcd-b183-4f39-9c97-f0fdfcb7c811 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1727 microversion: 2.20 time: 0.336147 Sep 09 13:02:07.170538 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 325/649] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:02:06 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1727 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:02:07.500390 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-318811b2-3b0f-4d72-902c-66869a232cf5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:07.501609 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-318811b2-3b0f-4d72-902c-66869a232cf5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:07.512685 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-318811b2-3b0f-4d72-902c-66869a232cf5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:07.518088 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-318811b2-3b0f-4d72-902c-66869a232cf5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:07.518884 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-318811b2-3b0f-4d72-902c-66869a232cf5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:07.520201 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-318811b2-3b0f-4d72-902c-66869a232cf5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:07.520201 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-318811b2-3b0f-4d72-902c-66869a232cf5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:07.521047 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-318811b2-3b0f-4d72-902c-66869a232cf5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:07.600979 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-318811b2-3b0f-4d72-902c-66869a232cf5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:07.609457 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-318811b2-3b0f-4d72-902c-66869a232cf5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1211 microversion: 2.1 time: 0.117848 Sep 09 13:02:07.611100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 325/650] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:07 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1211 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:08.200657 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-dbae4d59-f8fb-4def-99ea-de1767a54abb tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:08.204496 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-dbae4d59-f8fb-4def-99ea-de1767a54abb tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:08.224944 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dbae4d59-f8fb-4def-99ea-de1767a54abb tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:08.225809 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dbae4d59-f8fb-4def-99ea-de1767a54abb tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:08.227357 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dbae4d59-f8fb-4def-99ea-de1767a54abb tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:08.231086 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dbae4d59-f8fb-4def-99ea-de1767a54abb tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:08.232010 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dbae4d59-f8fb-4def-99ea-de1767a54abb tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:08.232881 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dbae4d59-f8fb-4def-99ea-de1767a54abb tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:08.538397 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-dbae4d59-f8fb-4def-99ea-de1767a54abb tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:08.549975 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-dbae4d59-f8fb-4def-99ea-de1767a54abb tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:08.557880 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-dbae4d59-f8fb-4def-99ea-de1767a54abb tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:08.559523 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-dbae4d59-f8fb-4def-99ea-de1767a54abb tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1727 microversion: 2.20 time: 0.371000 Sep 09 13:02:08.560543 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 326/651] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:02:08 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1727 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:02:08.641105 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-84911c00-8744-497b-9dae-f6f7c3583a81 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:08.642409 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-84911c00-8744-497b-9dae-f6f7c3583a81 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:08.668315 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-84911c00-8744-497b-9dae-f6f7c3583a81 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:08.669821 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-84911c00-8744-497b-9dae-f6f7c3583a81 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:08.672436 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-84911c00-8744-497b-9dae-f6f7c3583a81 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:08.674086 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-84911c00-8744-497b-9dae-f6f7c3583a81 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:08.675990 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-84911c00-8744-497b-9dae-f6f7c3583a81 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:08.677959 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-84911c00-8744-497b-9dae-f6f7c3583a81 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:08.939915 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-84911c00-8744-497b-9dae-f6f7c3583a81 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:08.948343 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-84911c00-8744-497b-9dae-f6f7c3583a81 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1279 microversion: 2.1 time: 0.316530 Sep 09 13:02:08.949225 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 326/652] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:08 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1279 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:09.587419 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-437beb04-672a-41ad-8604-b60aaea13a6a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:09.588623 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-437beb04-672a-41ad-8604-b60aaea13a6a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:09.595914 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-437beb04-672a-41ad-8604-b60aaea13a6a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:09.596410 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-437beb04-672a-41ad-8604-b60aaea13a6a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:09.596893 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-437beb04-672a-41ad-8604-b60aaea13a6a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:09.597639 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-437beb04-672a-41ad-8604-b60aaea13a6a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:09.598264 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-437beb04-672a-41ad-8604-b60aaea13a6a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:09.598844 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-437beb04-672a-41ad-8604-b60aaea13a6a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:09.817636 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-437beb04-672a-41ad-8604-b60aaea13a6a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:09.841771 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-437beb04-672a-41ad-8604-b60aaea13a6a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:09.845793 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-437beb04-672a-41ad-8604-b60aaea13a6a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:09.848929 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-437beb04-672a-41ad-8604-b60aaea13a6a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1727 microversion: 2.20 time: 0.264973 Sep 09 13:02:09.850727 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 327/653] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:02:09 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1727 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:02:09.965988 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-86cea8c4-874b-4c3b-9c4b-68ee435bd0ee tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:09.972603 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-fc5263a0-9198-49eb-8b42-f8e1a00e50ed tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:09.973474 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-fc5263a0-9198-49eb-8b42-f8e1a00e50ed tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:09.974873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-86cea8c4-874b-4c3b-9c4b-68ee435bd0ee tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:09.992284 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fc5263a0-9198-49eb-8b42-f8e1a00e50ed tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:09.992784 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fc5263a0-9198-49eb-8b42-f8e1a00e50ed tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:09.995983 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fc5263a0-9198-49eb-8b42-f8e1a00e50ed tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:09.996719 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fc5263a0-9198-49eb-8b42-f8e1a00e50ed tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:09.997181 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fc5263a0-9198-49eb-8b42-f8e1a00e50ed tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:09.997598 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fc5263a0-9198-49eb-8b42-f8e1a00e50ed tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:09.999310 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-86cea8c4-874b-4c3b-9c4b-68ee435bd0ee tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:09.999829 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-86cea8c4-874b-4c3b-9c4b-68ee435bd0ee tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:10.000543 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-86cea8c4-874b-4c3b-9c4b-68ee435bd0ee tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:10.001244 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-86cea8c4-874b-4c3b-9c4b-68ee435bd0ee tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:10.004001 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-86cea8c4-874b-4c3b-9c4b-68ee435bd0ee tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:10.004636 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-86cea8c4-874b-4c3b-9c4b-68ee435bd0ee tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:10.140633 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.objects.instance [None req-86cea8c4-874b-4c3b-9c4b-68ee435bd0ee tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lazy-loading 'services' on Instance uuid 54af832e-58c7-4e8c-9faf-318c9b33d2d7 {{(pid=127771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:02:10.365678 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-86cea8c4-874b-4c3b-9c4b-68ee435bd0ee tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "DELETE /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments/9312c3c4-1c94-4c77-af62-829ae7f9f574" status: 202 len: 0 microversion: 2.1 time: 0.403819 Sep 09 13:02:10.366366 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 327/654] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 13:02:09 2022] DELETE /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments/9312c3c4-1c94-4c77-af62-829ae7f9f574 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:02:10.376022 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-5ff1613a-04d4-49af-8a92-f6d489f16ada tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:10.379161 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-5ff1613a-04d4-49af-8a92-f6d489f16ada tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:10.387014 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5ff1613a-04d4-49af-8a92-f6d489f16ada tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:10.387900 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5ff1613a-04d4-49af-8a92-f6d489f16ada tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:10.388582 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5ff1613a-04d4-49af-8a92-f6d489f16ada tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:10.389522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5ff1613a-04d4-49af-8a92-f6d489f16ada tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:10.390211 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5ff1613a-04d4-49af-8a92-f6d489f16ada tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:10.390882 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5ff1613a-04d4-49af-8a92-f6d489f16ada tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:10.426426 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-5ff1613a-04d4-49af-8a92-f6d489f16ada tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054798 Sep 09 13:02:10.427332 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 328/655] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:02:10 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:02:10.561482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-fc5263a0-9198-49eb-8b42-f8e1a00e50ed tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:10.576414 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-fc5263a0-9198-49eb-8b42-f8e1a00e50ed tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1279 microversion: 2.1 time: 0.607884 Sep 09 13:02:10.577260 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 328/656] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:09 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1279 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:10.881509 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-6d2f5b7b-ccaa-422b-aeef-490e3ce69799 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:10.882469 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-6d2f5b7b-ccaa-422b-aeef-490e3ce69799 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:10.898163 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6d2f5b7b-ccaa-422b-aeef-490e3ce69799 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:10.899139 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6d2f5b7b-ccaa-422b-aeef-490e3ce69799 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:10.899758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6d2f5b7b-ccaa-422b-aeef-490e3ce69799 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:10.901572 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6d2f5b7b-ccaa-422b-aeef-490e3ce69799 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:10.902231 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6d2f5b7b-ccaa-422b-aeef-490e3ce69799 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:10.902961 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6d2f5b7b-ccaa-422b-aeef-490e3ce69799 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:11.131533 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-6d2f5b7b-ccaa-422b-aeef-490e3ce69799 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:11.142535 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-6d2f5b7b-ccaa-422b-aeef-490e3ce69799 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:11.144258 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-6d2f5b7b-ccaa-422b-aeef-490e3ce69799 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:11.145594 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-6d2f5b7b-ccaa-422b-aeef-490e3ce69799 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1727 microversion: 2.20 time: 0.268190 Sep 09 13:02:11.146302 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 329/657] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:02:10 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1727 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:02:11.440962 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e189ba7b-ae45-47c3-aed0-595c8832703e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:11.450035 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e189ba7b-ae45-47c3-aed0-595c8832703e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:11.461475 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e189ba7b-ae45-47c3-aed0-595c8832703e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:11.462386 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e189ba7b-ae45-47c3-aed0-595c8832703e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:11.463550 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e189ba7b-ae45-47c3-aed0-595c8832703e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:11.472804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e189ba7b-ae45-47c3-aed0-595c8832703e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:11.479896 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e189ba7b-ae45-47c3-aed0-595c8832703e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:11.480595 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e189ba7b-ae45-47c3-aed0-595c8832703e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:11.565325 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e189ba7b-ae45-47c3-aed0-595c8832703e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128355 Sep 09 13:02:11.566175 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 329/658] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:02:11 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:02:11.605029 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2a24d665-7ea7-4f0d-89c0-2cd434d2b322 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:11.605735 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2a24d665-7ea7-4f0d-89c0-2cd434d2b322 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:11.620880 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2a24d665-7ea7-4f0d-89c0-2cd434d2b322 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:11.621914 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2a24d665-7ea7-4f0d-89c0-2cd434d2b322 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:11.622849 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2a24d665-7ea7-4f0d-89c0-2cd434d2b322 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:11.623787 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2a24d665-7ea7-4f0d-89c0-2cd434d2b322 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:11.624440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2a24d665-7ea7-4f0d-89c0-2cd434d2b322 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:11.625062 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2a24d665-7ea7-4f0d-89c0-2cd434d2b322 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:11.776950 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2a24d665-7ea7-4f0d-89c0-2cd434d2b322 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:11.785047 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2a24d665-7ea7-4f0d-89c0-2cd434d2b322 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1279 microversion: 2.1 time: 0.184930 Sep 09 13:02:11.785635 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 330/659] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:11 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1279 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:12.182274 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7579fa5f-9e47-4be2-ac0d-5bd96a55ec05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:12.184603 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7579fa5f-9e47-4be2-ac0d-5bd96a55ec05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:12.189209 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7579fa5f-9e47-4be2-ac0d-5bd96a55ec05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:12.189699 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7579fa5f-9e47-4be2-ac0d-5bd96a55ec05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:12.190141 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7579fa5f-9e47-4be2-ac0d-5bd96a55ec05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:12.190900 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7579fa5f-9e47-4be2-ac0d-5bd96a55ec05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:12.191505 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7579fa5f-9e47-4be2-ac0d-5bd96a55ec05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:12.191764 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7579fa5f-9e47-4be2-ac0d-5bd96a55ec05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:12.471201 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7579fa5f-9e47-4be2-ac0d-5bd96a55ec05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:12.483373 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7579fa5f-9e47-4be2-ac0d-5bd96a55ec05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:12.485563 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7579fa5f-9e47-4be2-ac0d-5bd96a55ec05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:12.491929 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7579fa5f-9e47-4be2-ac0d-5bd96a55ec05 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1727 microversion: 2.20 time: 0.322590 Sep 09 13:02:12.492716 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 330/660] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:02:12 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1727 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:02:12.578652 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-46130c5b-5642-47f5-a055-fb6034a78ed1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:12.581897 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-46130c5b-5642-47f5-a055-fb6034a78ed1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:12.594658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-46130c5b-5642-47f5-a055-fb6034a78ed1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:12.595481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-46130c5b-5642-47f5-a055-fb6034a78ed1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:12.596122 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-46130c5b-5642-47f5-a055-fb6034a78ed1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:12.597007 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-46130c5b-5642-47f5-a055-fb6034a78ed1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:12.597618 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-46130c5b-5642-47f5-a055-fb6034a78ed1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:12.598205 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-46130c5b-5642-47f5-a055-fb6034a78ed1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:12.654070 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-46130c5b-5642-47f5-a055-fb6034a78ed1 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080007 Sep 09 13:02:12.658890 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 331/661] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:02:12 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:02:12.809299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-54ada244-4863-4907-a644-dddc315ca782 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:12.810371 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-54ada244-4863-4907-a644-dddc315ca782 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:12.817546 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-54ada244-4863-4907-a644-dddc315ca782 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:12.818383 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-54ada244-4863-4907-a644-dddc315ca782 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:12.818888 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-54ada244-4863-4907-a644-dddc315ca782 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:12.819809 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-54ada244-4863-4907-a644-dddc315ca782 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:12.820429 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-54ada244-4863-4907-a644-dddc315ca782 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:12.821285 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-54ada244-4863-4907-a644-dddc315ca782 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:12.979993 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-54ada244-4863-4907-a644-dddc315ca782 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:12.992408 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-54ada244-4863-4907-a644-dddc315ca782 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1279 microversion: 2.1 time: 0.187245 Sep 09 13:02:12.993758 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 331/662] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:12 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1279 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:13.517337 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-1657d595-0c77-4c80-ab07-2ba363467c16 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:13.517984 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-1657d595-0c77-4c80-ab07-2ba363467c16 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:13.524053 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1657d595-0c77-4c80-ab07-2ba363467c16 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:13.524539 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1657d595-0c77-4c80-ab07-2ba363467c16 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:13.524985 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1657d595-0c77-4c80-ab07-2ba363467c16 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:13.525715 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1657d595-0c77-4c80-ab07-2ba363467c16 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:13.526170 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1657d595-0c77-4c80-ab07-2ba363467c16 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:13.526685 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1657d595-0c77-4c80-ab07-2ba363467c16 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:13.667924 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c8933fde-2caf-4b68-b9f6-c632fa6e7021 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:13.671175 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-1657d595-0c77-4c80-ab07-2ba363467c16 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:13.680601 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-1657d595-0c77-4c80-ab07-2ba363467c16 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:13.682082 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-1657d595-0c77-4c80-ab07-2ba363467c16 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:13.683265 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-1657d595-0c77-4c80-ab07-2ba363467c16 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1727 microversion: 2.20 time: 0.169931 Sep 09 13:02:13.683823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 332/663] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:02:13 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:02:13.684428 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-c8933fde-2caf-4b68-b9f6-c632fa6e7021 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:13.687369 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=2 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:02:13.688015 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=6 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:02:13.691877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c8933fde-2caf-4b68-b9f6-c632fa6e7021 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:13.692378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c8933fde-2caf-4b68-b9f6-c632fa6e7021 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:13.692995 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c8933fde-2caf-4b68-b9f6-c632fa6e7021 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:13.693877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c8933fde-2caf-4b68-b9f6-c632fa6e7021 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:13.694358 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c8933fde-2caf-4b68-b9f6-c632fa6e7021 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:13.694818 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c8933fde-2caf-4b68-b9f6-c632fa6e7021 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:13.731329 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-c8933fde-2caf-4b68-b9f6-c632fa6e7021 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068279 Sep 09 13:02:13.732229 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 332/664] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:02:13 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:02:14.034712 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-bde2ca10-ed94-4221-9c44-ef7cbdd46060 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:14.040567 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-bde2ca10-ed94-4221-9c44-ef7cbdd46060 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:14.062719 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bde2ca10-ed94-4221-9c44-ef7cbdd46060 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:14.063226 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bde2ca10-ed94-4221-9c44-ef7cbdd46060 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:14.063667 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bde2ca10-ed94-4221-9c44-ef7cbdd46060 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:14.064379 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bde2ca10-ed94-4221-9c44-ef7cbdd46060 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:14.064836 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bde2ca10-ed94-4221-9c44-ef7cbdd46060 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:14.065267 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bde2ca10-ed94-4221-9c44-ef7cbdd46060 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:14.195706 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=2 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:02:14.230822 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-bde2ca10-ed94-4221-9c44-ef7cbdd46060 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:14.238542 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-bde2ca10-ed94-4221-9c44-ef7cbdd46060 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1279 microversion: 2.1 time: 0.208787 Sep 09 13:02:14.244828 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 333/665] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:14 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1279 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:14.709944 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-803a0df7-5679-4474-9383-7c00988fc681 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:14.710616 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-803a0df7-5679-4474-9383-7c00988fc681 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:14.719706 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-803a0df7-5679-4474-9383-7c00988fc681 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:14.720418 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-803a0df7-5679-4474-9383-7c00988fc681 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:14.721026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-803a0df7-5679-4474-9383-7c00988fc681 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:14.721902 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-803a0df7-5679-4474-9383-7c00988fc681 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:14.722526 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-803a0df7-5679-4474-9383-7c00988fc681 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:14.723112 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-803a0df7-5679-4474-9383-7c00988fc681 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:14.745929 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-7a6d4d45-3826-4576-bd0a-13ca25d75598 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:14.748045 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-7a6d4d45-3826-4576-bd0a-13ca25d75598 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:14.763477 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7a6d4d45-3826-4576-bd0a-13ca25d75598 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:14.764320 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7a6d4d45-3826-4576-bd0a-13ca25d75598 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:14.764959 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7a6d4d45-3826-4576-bd0a-13ca25d75598 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:14.765682 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7a6d4d45-3826-4576-bd0a-13ca25d75598 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:14.766147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7a6d4d45-3826-4576-bd0a-13ca25d75598 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:14.766613 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7a6d4d45-3826-4576-bd0a-13ca25d75598 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:14.800593 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-7a6d4d45-3826-4576-bd0a-13ca25d75598 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060473 Sep 09 13:02:14.801183 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 334/666] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:02:14 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:02:14.882638 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-803a0df7-5679-4474-9383-7c00988fc681 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:14.892238 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-803a0df7-5679-4474-9383-7c00988fc681 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:14.893865 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-803a0df7-5679-4474-9383-7c00988fc681 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:14.895190 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-803a0df7-5679-4474-9383-7c00988fc681 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1727 microversion: 2.20 time: 0.190651 Sep 09 13:02:14.896057 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 333/667] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:02:14 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1727 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:02:15.266016 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2e30d9be-aa3c-4b0e-99ce-c7ba1d50fcc9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:15.268493 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2e30d9be-aa3c-4b0e-99ce-c7ba1d50fcc9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:15.273092 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2e30d9be-aa3c-4b0e-99ce-c7ba1d50fcc9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:15.273577 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2e30d9be-aa3c-4b0e-99ce-c7ba1d50fcc9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:15.274217 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2e30d9be-aa3c-4b0e-99ce-c7ba1d50fcc9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:15.275165 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2e30d9be-aa3c-4b0e-99ce-c7ba1d50fcc9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:15.275816 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2e30d9be-aa3c-4b0e-99ce-c7ba1d50fcc9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:15.276697 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2e30d9be-aa3c-4b0e-99ce-c7ba1d50fcc9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:15.429216 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2e30d9be-aa3c-4b0e-99ce-c7ba1d50fcc9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:15.439836 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2e30d9be-aa3c-4b0e-99ce-c7ba1d50fcc9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1279 microversion: 2.1 time: 0.177612 Sep 09 13:02:15.440771 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 335/668] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:15 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1279 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:15.816534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-f4090b41-3973-4c62-97f5-ea5559ab6cfe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:15.818683 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-f4090b41-3973-4c62-97f5-ea5559ab6cfe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:15.826024 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f4090b41-3973-4c62-97f5-ea5559ab6cfe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:15.826522 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f4090b41-3973-4c62-97f5-ea5559ab6cfe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:15.827172 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f4090b41-3973-4c62-97f5-ea5559ab6cfe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:15.827873 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f4090b41-3973-4c62-97f5-ea5559ab6cfe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:15.828329 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f4090b41-3973-4c62-97f5-ea5559ab6cfe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:15.828753 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f4090b41-3973-4c62-97f5-ea5559ab6cfe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:15.862446 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-f4090b41-3973-4c62-97f5-ea5559ab6cfe tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051697 Sep 09 13:02:15.863870 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 334/669] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:02:15 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:02:15.928210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-39b6eb2b-1b00-46d6-bb30-0e9979603383 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:15.928830 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-39b6eb2b-1b00-46d6-bb30-0e9979603383 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:15.937245 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-39b6eb2b-1b00-46d6-bb30-0e9979603383 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:15.940373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-39b6eb2b-1b00-46d6-bb30-0e9979603383 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:15.942103 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-39b6eb2b-1b00-46d6-bb30-0e9979603383 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:15.943081 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-39b6eb2b-1b00-46d6-bb30-0e9979603383 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:15.943541 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-39b6eb2b-1b00-46d6-bb30-0e9979603383 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:15.943968 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-39b6eb2b-1b00-46d6-bb30-0e9979603383 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:16.106958 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-39b6eb2b-1b00-46d6-bb30-0e9979603383 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:16.116229 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-39b6eb2b-1b00-46d6-bb30-0e9979603383 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:16.117708 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-39b6eb2b-1b00-46d6-bb30-0e9979603383 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:16.119193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-39b6eb2b-1b00-46d6-bb30-0e9979603383 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1727 microversion: 2.20 time: 0.195145 Sep 09 13:02:16.120379 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 336/670] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:02:15 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1727 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:02:16.474009 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e1b85e93-9aaf-41e9-a10a-707a6ad88454 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:16.474009 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e1b85e93-9aaf-41e9-a10a-707a6ad88454 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:16.474009 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e1b85e93-9aaf-41e9-a10a-707a6ad88454 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:16.474009 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e1b85e93-9aaf-41e9-a10a-707a6ad88454 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:16.475397 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e1b85e93-9aaf-41e9-a10a-707a6ad88454 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:16.475721 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e1b85e93-9aaf-41e9-a10a-707a6ad88454 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:16.476261 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e1b85e93-9aaf-41e9-a10a-707a6ad88454 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:16.476748 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e1b85e93-9aaf-41e9-a10a-707a6ad88454 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:16.626829 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e1b85e93-9aaf-41e9-a10a-707a6ad88454 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:16.634648 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e1b85e93-9aaf-41e9-a10a-707a6ad88454 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1279 microversion: 2.1 time: 0.171905 Sep 09 13:02:16.635789 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 335/671] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:16 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1279 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:16.876861 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-591dde8b-c0e7-471a-9dcf-076f2d180662 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:16.879417 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-591dde8b-c0e7-471a-9dcf-076f2d180662 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:16.885649 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-591dde8b-c0e7-471a-9dcf-076f2d180662 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:16.887258 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-591dde8b-c0e7-471a-9dcf-076f2d180662 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:16.887258 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-591dde8b-c0e7-471a-9dcf-076f2d180662 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:16.888225 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-591dde8b-c0e7-471a-9dcf-076f2d180662 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:16.888726 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-591dde8b-c0e7-471a-9dcf-076f2d180662 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:16.889368 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-591dde8b-c0e7-471a-9dcf-076f2d180662 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:16.909130 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:02:16.923872 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-591dde8b-c0e7-471a-9dcf-076f2d180662 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051080 Sep 09 13:02:16.929082 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 337/672] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:02:16 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:02:17.145048 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-fe9f0707-ad24-4537-942a-2b613b07ea90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:17.145653 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-fe9f0707-ad24-4537-942a-2b613b07ea90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:17.152780 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fe9f0707-ad24-4537-942a-2b613b07ea90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:17.163259 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fe9f0707-ad24-4537-942a-2b613b07ea90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:17.163715 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fe9f0707-ad24-4537-942a-2b613b07ea90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:17.164453 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fe9f0707-ad24-4537-942a-2b613b07ea90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:17.164909 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fe9f0707-ad24-4537-942a-2b613b07ea90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:17.165336 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fe9f0707-ad24-4537-942a-2b613b07ea90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:17.423518 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-fe9f0707-ad24-4537-942a-2b613b07ea90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:17.432070 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-fe9f0707-ad24-4537-942a-2b613b07ea90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:17.436132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-fe9f0707-ad24-4537-942a-2b613b07ea90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:17.436132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-fe9f0707-ad24-4537-942a-2b613b07ea90 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1727 microversion: 2.20 time: 0.293525 Sep 09 13:02:17.436132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 336/673] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:02:17 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1727 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:02:17.659101 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a8432a7c-d058-4bf7-94de-30dbb14f2adf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:17.659877 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-a8432a7c-d058-4bf7-94de-30dbb14f2adf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:17.666593 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a8432a7c-d058-4bf7-94de-30dbb14f2adf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:17.667217 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a8432a7c-d058-4bf7-94de-30dbb14f2adf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:17.667662 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a8432a7c-d058-4bf7-94de-30dbb14f2adf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:17.668371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a8432a7c-d058-4bf7-94de-30dbb14f2adf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:17.668822 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a8432a7c-d058-4bf7-94de-30dbb14f2adf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:17.669435 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a8432a7c-d058-4bf7-94de-30dbb14f2adf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:17.818475 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-a8432a7c-d058-4bf7-94de-30dbb14f2adf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:17.831946 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-a8432a7c-d058-4bf7-94de-30dbb14f2adf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1279 microversion: 2.1 time: 0.176640 Sep 09 13:02:17.835736 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 338/674] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:17 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1279 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:17.938067 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-bd33a889-7b1b-4dc6-9036-768af956c98f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:17.942239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-bd33a889-7b1b-4dc6-9036-768af956c98f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:17.950231 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bd33a889-7b1b-4dc6-9036-768af956c98f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:17.950775 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bd33a889-7b1b-4dc6-9036-768af956c98f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:17.951312 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bd33a889-7b1b-4dc6-9036-768af956c98f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:17.952039 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bd33a889-7b1b-4dc6-9036-768af956c98f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:17.952761 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bd33a889-7b1b-4dc6-9036-768af956c98f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:17.953164 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bd33a889-7b1b-4dc6-9036-768af956c98f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:17.988535 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-bd33a889-7b1b-4dc6-9036-768af956c98f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054830 Sep 09 13:02:17.989801 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 337/675] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:02:17 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:02:18.028201 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-626baaed-cc8e-4aad-bd4d-d44ccf56c324 req-7fe004a3-68b5-415d-b3da-2c1d8874eac9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a161d78-b95c-41f2-a747-3bc9376c5058", "tag": "be2358f4-e985-4509-9168-4b4923220982"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:02:18.045478 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-626baaed-cc8e-4aad-bd4d-d44ccf56c324 req-7fe004a3-68b5-415d-b3da-2c1d8874eac9 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:18.045964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-626baaed-cc8e-4aad-bd4d-d44ccf56c324 req-7fe004a3-68b5-415d-b3da-2c1d8874eac9 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:18.046398 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-626baaed-cc8e-4aad-bd4d-d44ccf56c324 req-7fe004a3-68b5-415d-b3da-2c1d8874eac9 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:18.066781 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-626baaed-cc8e-4aad-bd4d-d44ccf56c324 req-7fe004a3-68b5-415d-b3da-2c1d8874eac9 service nova] Creating event network-changed:be2358f4-e985-4509-9168-4b4923220982 for instance 2a161d78-b95c-41f2-a747-3bc9376c5058 on hv-cinder-81322 Sep 09 13:02:18.072528 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-626baaed-cc8e-4aad-bd4d-d44ccf56c324 req-7fe004a3-68b5-415d-b3da-2c1d8874eac9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050238 Sep 09 13:02:18.073670 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 339/676] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:02:18.461701 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-828c1dd6-d6c1-4919-8895-623029524004 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:18.463676 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-828c1dd6-d6c1-4919-8895-623029524004 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:18.474092 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-828c1dd6-d6c1-4919-8895-623029524004 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:18.474930 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-828c1dd6-d6c1-4919-8895-623029524004 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:18.476022 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-828c1dd6-d6c1-4919-8895-623029524004 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:18.478168 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-828c1dd6-d6c1-4919-8895-623029524004 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:18.479737 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-828c1dd6-d6c1-4919-8895-623029524004 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:18.483122 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-828c1dd6-d6c1-4919-8895-623029524004 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:18.716864 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-828c1dd6-d6c1-4919-8895-623029524004 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:18.730933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-828c1dd6-d6c1-4919-8895-623029524004 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:18.733828 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-828c1dd6-d6c1-4919-8895-623029524004 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:18.735969 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-828c1dd6-d6c1-4919-8895-623029524004 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1727 microversion: 2.20 time: 0.279108 Sep 09 13:02:18.750129 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 338/677] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:02:18 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1727 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:02:18.861278 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-da300f24-e305-4133-b7a4-2058a010cf30 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:18.862065 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-da300f24-e305-4133-b7a4-2058a010cf30 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:18.873502 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-da300f24-e305-4133-b7a4-2058a010cf30 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:18.874069 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-da300f24-e305-4133-b7a4-2058a010cf30 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:18.874648 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-da300f24-e305-4133-b7a4-2058a010cf30 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:18.875397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-da300f24-e305-4133-b7a4-2058a010cf30 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:18.875862 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-da300f24-e305-4133-b7a4-2058a010cf30 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:18.876305 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-da300f24-e305-4133-b7a4-2058a010cf30 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:19.003566 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e091a8c1-90f0-4618-b60d-f6269fb1a0be tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:19.005731 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e091a8c1-90f0-4618-b60d-f6269fb1a0be tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:19.013867 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e091a8c1-90f0-4618-b60d-f6269fb1a0be tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:19.014371 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e091a8c1-90f0-4618-b60d-f6269fb1a0be tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:19.014845 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e091a8c1-90f0-4618-b60d-f6269fb1a0be tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:19.016108 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e091a8c1-90f0-4618-b60d-f6269fb1a0be tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:19.016576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e091a8c1-90f0-4618-b60d-f6269fb1a0be tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:19.017010 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e091a8c1-90f0-4618-b60d-f6269fb1a0be tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:19.061012 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e091a8c1-90f0-4618-b60d-f6269fb1a0be tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063312 Sep 09 13:02:19.061801 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 339/678] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:02:18 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 13:02:19.168046 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-decd3952-8078-4a32-8f75-6f5a05386121 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:19.170874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-decd3952-8078-4a32-8f75-6f5a05386121 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:19.180408 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-decd3952-8078-4a32-8f75-6f5a05386121 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:19.181209 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-decd3952-8078-4a32-8f75-6f5a05386121 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:19.182453 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-decd3952-8078-4a32-8f75-6f5a05386121 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:19.183411 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-decd3952-8078-4a32-8f75-6f5a05386121 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:19.184034 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-decd3952-8078-4a32-8f75-6f5a05386121 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:19.184624 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-decd3952-8078-4a32-8f75-6f5a05386121 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:19.211368 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=100 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:02:19.221304 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-decd3952-8078-4a32-8f75-6f5a05386121 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Going to try to terminate instance {{(pid=127772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:02:19.239793 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-da300f24-e305-4133-b7a4-2058a010cf30 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:19.254274 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-da300f24-e305-4133-b7a4-2058a010cf30 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1267 microversion: 2.1 time: 0.398789 Sep 09 13:02:19.255029 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 340/679] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:18 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1267 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:19.514417 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-decd3952-8078-4a32-8f75-6f5a05386121 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "DELETE /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 204 len: 0 microversion: 2.1 time: 0.351022 Sep 09 13:02:19.516677 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 340/680] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:02:19 2022] DELETE /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 13:02:19.524723 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-54163791-5172-42ac-943a-c1f58d6763c3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:19.525360 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-54163791-5172-42ac-943a-c1f58d6763c3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:19.531267 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-54163791-5172-42ac-943a-c1f58d6763c3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:19.531752 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-54163791-5172-42ac-943a-c1f58d6763c3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:19.532184 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-54163791-5172-42ac-943a-c1f58d6763c3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:19.532884 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-54163791-5172-42ac-943a-c1f58d6763c3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:19.533346 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-54163791-5172-42ac-943a-c1f58d6763c3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:19.533779 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-54163791-5172-42ac-943a-c1f58d6763c3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:19.770732 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-54163791-5172-42ac-943a-c1f58d6763c3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:19.778916 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7715b69c-f6b6-4125-a38a-79447010cf46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:19.779255 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-54163791-5172-42ac-943a-c1f58d6763c3 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1688 microversion: 2.1 time: 0.258231 Sep 09 13:02:19.779647 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7715b69c-f6b6-4125-a38a-79447010cf46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:19.780217 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 341/681] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:19 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1688 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:19.793125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7715b69c-f6b6-4125-a38a-79447010cf46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:19.794011 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7715b69c-f6b6-4125-a38a-79447010cf46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:19.794625 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7715b69c-f6b6-4125-a38a-79447010cf46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:19.795515 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7715b69c-f6b6-4125-a38a-79447010cf46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:19.796120 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7715b69c-f6b6-4125-a38a-79447010cf46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:19.796711 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7715b69c-f6b6-4125-a38a-79447010cf46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:19.948045 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7715b69c-f6b6-4125-a38a-79447010cf46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:19.956360 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7715b69c-f6b6-4125-a38a-79447010cf46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:19.957791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7715b69c-f6b6-4125-a38a-79447010cf46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:19.958974 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7715b69c-f6b6-4125-a38a-79447010cf46 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1727 microversion: 2.20 time: 0.191003 Sep 09 13:02:19.964696 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 341/682] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:02:19 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1727 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:02:20.280978 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d08f733f-98c5-41c8-94bb-02be1f8414be tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:20.281597 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-d08f733f-98c5-41c8-94bb-02be1f8414be tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:20.288399 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d08f733f-98c5-41c8-94bb-02be1f8414be tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:20.288894 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d08f733f-98c5-41c8-94bb-02be1f8414be tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:20.289539 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d08f733f-98c5-41c8-94bb-02be1f8414be tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:20.290274 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d08f733f-98c5-41c8-94bb-02be1f8414be tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:20.290776 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d08f733f-98c5-41c8-94bb-02be1f8414be tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:20.291475 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d08f733f-98c5-41c8-94bb-02be1f8414be tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:20.447973 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-d08f733f-98c5-41c8-94bb-02be1f8414be tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:20.456810 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d08f733f-98c5-41c8-94bb-02be1f8414be tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1267 microversion: 2.1 time: 0.179750 Sep 09 13:02:20.457501 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 342/683] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:20 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:20.806722 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-6a86b473-9e0a-4c3d-a7c6-37f23d3d2f49 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:20.807989 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-6a86b473-9e0a-4c3d-a7c6-37f23d3d2f49 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:20.814575 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6a86b473-9e0a-4c3d-a7c6-37f23d3d2f49 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:20.815425 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6a86b473-9e0a-4c3d-a7c6-37f23d3d2f49 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:20.816106 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6a86b473-9e0a-4c3d-a7c6-37f23d3d2f49 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:20.817309 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6a86b473-9e0a-4c3d-a7c6-37f23d3d2f49 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:20.817991 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6a86b473-9e0a-4c3d-a7c6-37f23d3d2f49 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:20.819538 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6a86b473-9e0a-4c3d-a7c6-37f23d3d2f49 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:20.986165 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-7ea1093f-01d1-419c-a025-2ba067db6e86 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:20.987267 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-7ea1093f-01d1-419c-a025-2ba067db6e86 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:20.996606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7ea1093f-01d1-419c-a025-2ba067db6e86 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:20.997393 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7ea1093f-01d1-419c-a025-2ba067db6e86 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:20.998063 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7ea1093f-01d1-419c-a025-2ba067db6e86 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:20.998916 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-6a86b473-9e0a-4c3d-a7c6-37f23d3d2f49 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:21.005556 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7ea1093f-01d1-419c-a025-2ba067db6e86 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:21.005556 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7ea1093f-01d1-419c-a025-2ba067db6e86 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:21.005556 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7ea1093f-01d1-419c-a025-2ba067db6e86 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:21.011299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-6a86b473-9e0a-4c3d-a7c6-37f23d3d2f49 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1688 microversion: 2.1 time: 0.208739 Sep 09 13:02:21.012339 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 342/684] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:20 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1688 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:21.145778 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-7ea1093f-01d1-419c-a025-2ba067db6e86 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:21.167103 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-7ea1093f-01d1-419c-a025-2ba067db6e86 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:21.171117 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-7ea1093f-01d1-419c-a025-2ba067db6e86 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:21.178661 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-7ea1093f-01d1-419c-a025-2ba067db6e86 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1727 microversion: 2.20 time: 0.190950 Sep 09 13:02:21.180638 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 343/685] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:02:20 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1727 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:02:21.481603 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-8f840861-7c2b-48fe-a0c7-7fa08a593566 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:21.482763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-8f840861-7c2b-48fe-a0c7-7fa08a593566 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:21.489437 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8f840861-7c2b-48fe-a0c7-7fa08a593566 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:21.490326 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8f840861-7c2b-48fe-a0c7-7fa08a593566 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:21.491043 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8f840861-7c2b-48fe-a0c7-7fa08a593566 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:21.492054 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8f840861-7c2b-48fe-a0c7-7fa08a593566 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:21.492948 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8f840861-7c2b-48fe-a0c7-7fa08a593566 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:21.493614 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8f840861-7c2b-48fe-a0c7-7fa08a593566 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:21.804448 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-8f840861-7c2b-48fe-a0c7-7fa08a593566 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:21.825346 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-8f840861-7c2b-48fe-a0c7-7fa08a593566 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1267 microversion: 2.1 time: 0.348188 Sep 09 13:02:21.839346 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 343/686] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:21 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1267 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:22.078522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-f5b09ab7-f3a6-4614-b2d6-c411898ef6cb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:22.078522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-f5b09ab7-f3a6-4614-b2d6-c411898ef6cb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:22.078522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f5b09ab7-f3a6-4614-b2d6-c411898ef6cb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:22.078522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f5b09ab7-f3a6-4614-b2d6-c411898ef6cb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:22.079334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f5b09ab7-f3a6-4614-b2d6-c411898ef6cb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:22.079334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f5b09ab7-f3a6-4614-b2d6-c411898ef6cb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:22.079334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f5b09ab7-f3a6-4614-b2d6-c411898ef6cb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:22.079334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f5b09ab7-f3a6-4614-b2d6-c411898ef6cb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:22.205139 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ca06aa55-10c2-4454-ae6c-67ec5e2eeb4a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:22.205810 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-ca06aa55-10c2-4454-ae6c-67ec5e2eeb4a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:22.210475 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-f5b09ab7-f3a6-4614-b2d6-c411898ef6cb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:22.212617 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ca06aa55-10c2-4454-ae6c-67ec5e2eeb4a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:22.214390 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ca06aa55-10c2-4454-ae6c-67ec5e2eeb4a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:22.214865 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ca06aa55-10c2-4454-ae6c-67ec5e2eeb4a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:22.215576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ca06aa55-10c2-4454-ae6c-67ec5e2eeb4a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:22.216030 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ca06aa55-10c2-4454-ae6c-67ec5e2eeb4a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:22.216450 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ca06aa55-10c2-4454-ae6c-67ec5e2eeb4a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:22.219443 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-f5b09ab7-f3a6-4614-b2d6-c411898ef6cb tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1688 microversion: 2.1 time: 0.187370 Sep 09 13:02:22.220048 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 344/687] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:22 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:02:22.367410 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ca06aa55-10c2-4454-ae6c-67ec5e2eeb4a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:22.376725 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ca06aa55-10c2-4454-ae6c-67ec5e2eeb4a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:22.378259 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ca06aa55-10c2-4454-ae6c-67ec5e2eeb4a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:22.379401 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-ca06aa55-10c2-4454-ae6c-67ec5e2eeb4a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1727 microversion: 2.20 time: 0.178751 Sep 09 13:02:22.380002 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 344/688] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:02:22 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:02:22.852523 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-170466d1-5ea9-40ef-aefa-999e5077a262 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:22.853161 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-170466d1-5ea9-40ef-aefa-999e5077a262 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:22.861083 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-170466d1-5ea9-40ef-aefa-999e5077a262 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:22.861579 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-170466d1-5ea9-40ef-aefa-999e5077a262 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:22.862015 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-170466d1-5ea9-40ef-aefa-999e5077a262 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:22.862752 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-170466d1-5ea9-40ef-aefa-999e5077a262 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:22.863204 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-170466d1-5ea9-40ef-aefa-999e5077a262 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:22.863625 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-170466d1-5ea9-40ef-aefa-999e5077a262 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:22.892282 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-138c27d4-7fc0-4e60-ade3-81a71f670b63 req-8b57299e-1593-4eca-9701-75a6922268a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37305bac-ecac-4f89-a340-55d5ffc7a775", "name": "network-vif-plugged", "status": "completed", "tag": "10813693-1d59-4806-bfad-10fa8cfeba3b"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:02:22.903821 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-138c27d4-7fc0-4e60-ade3-81a71f670b63 req-8b57299e-1593-4eca-9701-75a6922268a3 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:22.906676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-138c27d4-7fc0-4e60-ade3-81a71f670b63 req-8b57299e-1593-4eca-9701-75a6922268a3 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:22.907146 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-138c27d4-7fc0-4e60-ade3-81a71f670b63 req-8b57299e-1593-4eca-9701-75a6922268a3 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:22.922514 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-138c27d4-7fc0-4e60-ade3-81a71f670b63 req-8b57299e-1593-4eca-9701-75a6922268a3 service nova] Creating event network-vif-plugged:10813693-1d59-4806-bfad-10fa8cfeba3b for instance 37305bac-ecac-4f89-a340-55d5ffc7a775 on hv-cinder-81322 Sep 09 13:02:22.927985 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-138c27d4-7fc0-4e60-ade3-81a71f670b63 req-8b57299e-1593-4eca-9701-75a6922268a3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216319 Sep 09 13:02:22.929032 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 345/689] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:02:23.252070 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2d5116e4-4b1d-4219-891f-d1a9e1a60ccf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:23.255871 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2d5116e4-4b1d-4219-891f-d1a9e1a60ccf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:23.263414 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2d5116e4-4b1d-4219-891f-d1a9e1a60ccf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:23.264415 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2d5116e4-4b1d-4219-891f-d1a9e1a60ccf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:23.265097 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2d5116e4-4b1d-4219-891f-d1a9e1a60ccf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:23.266852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2d5116e4-4b1d-4219-891f-d1a9e1a60ccf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:23.267643 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2d5116e4-4b1d-4219-891f-d1a9e1a60ccf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:23.268504 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2d5116e4-4b1d-4219-891f-d1a9e1a60ccf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:23.293821 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-170466d1-5ea9-40ef-aefa-999e5077a262 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:23.302746 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-170466d1-5ea9-40ef-aefa-999e5077a262 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1267 microversion: 2.1 time: 0.454773 Sep 09 13:02:23.310448 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 345/690] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:22 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1267 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:02:23.407208 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7a2645e1-9854-4cf0-a799-03530265e400 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:23.410784 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7a2645e1-9854-4cf0-a799-03530265e400 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:23.415035 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a2645e1-9854-4cf0-a799-03530265e400 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:23.417356 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a2645e1-9854-4cf0-a799-03530265e400 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:23.418005 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a2645e1-9854-4cf0-a799-03530265e400 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:23.419272 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a2645e1-9854-4cf0-a799-03530265e400 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:23.421157 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a2645e1-9854-4cf0-a799-03530265e400 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:23.422678 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7a2645e1-9854-4cf0-a799-03530265e400 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:23.521266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2d5116e4-4b1d-4219-891f-d1a9e1a60ccf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:23.531233 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2d5116e4-4b1d-4219-891f-d1a9e1a60ccf tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1688 microversion: 2.1 time: 0.292476 Sep 09 13:02:23.532007 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 346/691] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:23 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1688 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:02:23.739568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7a2645e1-9854-4cf0-a799-03530265e400 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:23.752316 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7a2645e1-9854-4cf0-a799-03530265e400 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:23.754203 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7a2645e1-9854-4cf0-a799-03530265e400 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:23.755726 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7a2645e1-9854-4cf0-a799-03530265e400 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1727 microversion: 2.20 time: 0.353539 Sep 09 13:02:23.757291 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 346/692] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:02:23 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1727 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:02:24.301164 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-8f91b7c6-57b6-4a97-aeb1-b873641de3e2 req-b2dff8fe-9e7b-4da2-ac71-97448bca26f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54af832e-58c7-4e8c-9faf-318c9b33d2d7", "name": "network-vif-deleted", "tag": "a964a7f9-bcef-4299-b1fc-2858bd8b14f1"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:02:24.312443 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-8f91b7c6-57b6-4a97-aeb1-b873641de3e2 req-b2dff8fe-9e7b-4da2-ac71-97448bca26f8 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:24.313159 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-8f91b7c6-57b6-4a97-aeb1-b873641de3e2 req-b2dff8fe-9e7b-4da2-ac71-97448bca26f8 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:24.313591 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-8f91b7c6-57b6-4a97-aeb1-b873641de3e2 req-b2dff8fe-9e7b-4da2-ac71-97448bca26f8 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:24.335651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-8f91b7c6-57b6-4a97-aeb1-b873641de3e2 req-b2dff8fe-9e7b-4da2-ac71-97448bca26f8 service nova] Creating event network-vif-deleted:a964a7f9-bcef-4299-b1fc-2858bd8b14f1 for instance 54af832e-58c7-4e8c-9faf-318c9b33d2d7 on hv-cinder-81322 Sep 09 13:02:24.336677 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-96f2bf59-d774-4ecc-abbb-958714ad94c7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:24.337408 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-96f2bf59-d774-4ecc-abbb-958714ad94c7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:24.343465 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-8f91b7c6-57b6-4a97-aeb1-b873641de3e2 req-b2dff8fe-9e7b-4da2-ac71-97448bca26f8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046328 Sep 09 13:02:24.345892 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 347/693] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:02:24.354079 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-96f2bf59-d774-4ecc-abbb-958714ad94c7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:24.357048 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-96f2bf59-d774-4ecc-abbb-958714ad94c7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:24.357547 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-96f2bf59-d774-4ecc-abbb-958714ad94c7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:24.362315 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-96f2bf59-d774-4ecc-abbb-958714ad94c7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:24.362315 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-96f2bf59-d774-4ecc-abbb-958714ad94c7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:24.362315 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-96f2bf59-d774-4ecc-abbb-958714ad94c7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:24.557520 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-cdbd55e9-d955-4006-a3d7-94b4304c1c9e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:24.558621 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-cdbd55e9-d955-4006-a3d7-94b4304c1c9e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:24.581327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cdbd55e9-d955-4006-a3d7-94b4304c1c9e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:24.581978 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cdbd55e9-d955-4006-a3d7-94b4304c1c9e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:24.582447 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cdbd55e9-d955-4006-a3d7-94b4304c1c9e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:24.586455 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cdbd55e9-d955-4006-a3d7-94b4304c1c9e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:24.587286 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cdbd55e9-d955-4006-a3d7-94b4304c1c9e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:24.588848 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cdbd55e9-d955-4006-a3d7-94b4304c1c9e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:24.610281 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-96f2bf59-d774-4ecc-abbb-958714ad94c7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:24.619106 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-96f2bf59-d774-4ecc-abbb-958714ad94c7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1267 microversion: 2.1 time: 0.286715 Sep 09 13:02:24.624311 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 347/694] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:24 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1267 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:24.648002 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7b251eb3-d46d-42b9-a6c4-580ea2fbddb0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:24.648809 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7b251eb3-d46d-42b9-a6c4-580ea2fbddb0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:24.656275 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7b251eb3-d46d-42b9-a6c4-580ea2fbddb0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:24.656764 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7b251eb3-d46d-42b9-a6c4-580ea2fbddb0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:24.657196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7b251eb3-d46d-42b9-a6c4-580ea2fbddb0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:24.662177 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7b251eb3-d46d-42b9-a6c4-580ea2fbddb0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:24.662728 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7b251eb3-d46d-42b9-a6c4-580ea2fbddb0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:24.663169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7b251eb3-d46d-42b9-a6c4-580ea2fbddb0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:24.714720 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7b251eb3-d46d-42b9-a6c4-580ea2fbddb0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811/ips" status: 200 len: 149 microversion: 2.1 time: 0.070682 Sep 09 13:02:24.715312 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 348/695] 10.222.0.46 () {58 vars in 1248 bytes} [Fri Sep 9 13:02:24 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811/ips => generated 149 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:02:24.775712 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-cdbd55e9-d955-4006-a3d7-94b4304c1c9e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:24.782812 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-82b06d46-e97b-4fb8-b7b6-ae8ee88cc24b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:24.783634 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-82b06d46-e97b-4fb8-b7b6-ae8ee88cc24b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:24.794500 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-82b06d46-e97b-4fb8-b7b6-ae8ee88cc24b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:24.797692 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-82b06d46-e97b-4fb8-b7b6-ae8ee88cc24b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:24.800251 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-82b06d46-e97b-4fb8-b7b6-ae8ee88cc24b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:24.808456 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-82b06d46-e97b-4fb8-b7b6-ae8ee88cc24b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:24.808456 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-82b06d46-e97b-4fb8-b7b6-ae8ee88cc24b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:24.808456 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-82b06d46-e97b-4fb8-b7b6-ae8ee88cc24b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:24.809738 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-cdbd55e9-d955-4006-a3d7-94b4304c1c9e tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1330 microversion: 2.1 time: 0.252005 Sep 09 13:02:24.810374 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 348/696] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:24 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1330 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:02:24.973530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-82b06d46-e97b-4fb8-b7b6-ae8ee88cc24b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:24.983045 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-82b06d46-e97b-4fb8-b7b6-ae8ee88cc24b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:24.984559 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-82b06d46-e97b-4fb8-b7b6-ae8ee88cc24b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:24.986586 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-82b06d46-e97b-4fb8-b7b6-ae8ee88cc24b tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1727 microversion: 2.20 time: 0.207746 Sep 09 13:02:24.988163 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 349/697] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:02:24 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1727 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:02:25.645417 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-af08d340-7b13-4947-b608-f7d8060cc5b3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:25.651778 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-af08d340-7b13-4947-b608-f7d8060cc5b3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:25.654337 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:02:25.659215 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-af08d340-7b13-4947-b608-f7d8060cc5b3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:25.659917 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-af08d340-7b13-4947-b608-f7d8060cc5b3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:25.660521 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-af08d340-7b13-4947-b608-f7d8060cc5b3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:25.661409 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-af08d340-7b13-4947-b608-f7d8060cc5b3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:25.662029 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-af08d340-7b13-4947-b608-f7d8060cc5b3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:25.662856 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-af08d340-7b13-4947-b608-f7d8060cc5b3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:25.841688 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c9f78656-a883-48eb-b979-876be0299c5b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:25.845151 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-c9f78656-a883-48eb-b979-876be0299c5b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:25.855489 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c9f78656-a883-48eb-b979-876be0299c5b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:25.855866 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c9f78656-a883-48eb-b979-876be0299c5b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:25.856472 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c9f78656-a883-48eb-b979-876be0299c5b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:25.857361 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c9f78656-a883-48eb-b979-876be0299c5b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:25.857978 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c9f78656-a883-48eb-b979-876be0299c5b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:25.858612 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c9f78656-a883-48eb-b979-876be0299c5b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:25.906425 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c9f78656-a883-48eb-b979-876be0299c5b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:25.907108 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c9f78656-a883-48eb-b979-876be0299c5b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:25.907645 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c9f78656-a883-48eb-b979-876be0299c5b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:25.908207 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.objects.instance [None req-c9f78656-a883-48eb-b979-876be0299c5b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lazy-loading 'fault' on Instance uuid 54af832e-58c7-4e8c-9faf-318c9b33d2d7 {{(pid=127772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:02:25.924035 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-af08d340-7b13-4947-b608-f7d8060cc5b3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:25.936469 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-af08d340-7b13-4947-b608-f7d8060cc5b3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1267 microversion: 2.1 time: 0.294863 Sep 09 13:02:25.937210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 349/698] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:25 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1267 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:25.972891 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c9f78656-a883-48eb-b979-876be0299c5b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:25.983127 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-c9f78656-a883-48eb-b979-876be0299c5b tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 200 len: 1335 microversion: 2.1 time: 0.151109 Sep 09 13:02:25.983926 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 350/699] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:25 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 1335 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:26.017558 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-33af3189-edc7-4f71-ade7-cfbdb018d360 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:26.018291 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-33af3189-edc7-4f71-ade7-cfbdb018d360 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:26.028425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-33af3189-edc7-4f71-ade7-cfbdb018d360 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:26.029130 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-33af3189-edc7-4f71-ade7-cfbdb018d360 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:26.030349 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-33af3189-edc7-4f71-ade7-cfbdb018d360 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:26.031382 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-33af3189-edc7-4f71-ade7-cfbdb018d360 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:26.032310 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-33af3189-edc7-4f71-ade7-cfbdb018d360 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:26.038434 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-33af3189-edc7-4f71-ade7-cfbdb018d360 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:26.200768 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-33af3189-edc7-4f71-ade7-cfbdb018d360 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:26.212478 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-33af3189-edc7-4f71-ade7-cfbdb018d360 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:26.215584 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-33af3189-edc7-4f71-ade7-cfbdb018d360 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:26.217097 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-33af3189-edc7-4f71-ade7-cfbdb018d360 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1727 microversion: 2.20 time: 0.205972 Sep 09 13:02:26.217665 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 350/700] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:02:26 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1727 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:02:26.591275 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-25e499e5-ea76-4a95-b3f3-f6cb86d265df tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6fac69ef-e737-43f1-975a-3270b1a0094a"}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:02:26.594069 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-25e499e5-ea76-4a95-b3f3-f6cb86d265df tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:26.599826 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-25e499e5-ea76-4a95-b3f3-f6cb86d265df tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:26.600547 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-25e499e5-ea76-4a95-b3f3-f6cb86d265df tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:26.601170 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-25e499e5-ea76-4a95-b3f3-f6cb86d265df tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:26.601884 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-25e499e5-ea76-4a95-b3f3-f6cb86d265df tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:26.602518 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-25e499e5-ea76-4a95-b3f3-f6cb86d265df tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:26.603108 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-25e499e5-ea76-4a95-b3f3-f6cb86d265df tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:26.965710 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-22ab0fef-c0d0-4c2f-b4c8-8123ad5910e6 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:26.968194 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-22ab0fef-c0d0-4c2f-b4c8-8123ad5910e6 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:26.977679 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-22ab0fef-c0d0-4c2f-b4c8-8123ad5910e6 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:26.978566 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-22ab0fef-c0d0-4c2f-b4c8-8123ad5910e6 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:26.979232 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-22ab0fef-c0d0-4c2f-b4c8-8123ad5910e6 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:26.980495 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-22ab0fef-c0d0-4c2f-b4c8-8123ad5910e6 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:26.981139 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-22ab0fef-c0d0-4c2f-b4c8-8123ad5910e6 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:26.981765 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-22ab0fef-c0d0-4c2f-b4c8-8123ad5910e6 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:27.201729 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-22ab0fef-c0d0-4c2f-b4c8-8123ad5910e6 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:27.214334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-22ab0fef-c0d0-4c2f-b4c8-8123ad5910e6 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1267 microversion: 2.1 time: 0.253037 Sep 09 13:02:27.226183 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 351/701] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:26 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1267 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:02:27.244873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2530383d-810f-4a27-b208-2b0a3da720dc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:27.246179 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2530383d-810f-4a27-b208-2b0a3da720dc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 54af832e-58c7-4e8c-9faf-318c9b33d2d7] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:27.262619 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2530383d-810f-4a27-b208-2b0a3da720dc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:27.263441 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2530383d-810f-4a27-b208-2b0a3da720dc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:27.263898 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2530383d-810f-4a27-b208-2b0a3da720dc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:27.265368 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2530383d-810f-4a27-b208-2b0a3da720dc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:27.265818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2530383d-810f-4a27-b208-2b0a3da720dc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:27.266813 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2530383d-810f-4a27-b208-2b0a3da720dc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:27.288395 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-2530383d-810f-4a27-b208-2b0a3da720dc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] HTTP exception thrown: Instance 54af832e-58c7-4e8c-9faf-318c9b33d2d7 could not be found. Sep 09 13:02:27.290066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2530383d-810f-4a27-b208-2b0a3da720dc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Request method failure captured: Sep 09 13:02:27.290066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 HTTP/1.1 Sep 09 13:02:27.290066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:02:27.290066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:02:27.290066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:02:27.290066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:02:27.290066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:02:27.290066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:02:27.290066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:02:27.290066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:02:27.290066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzhNsxk3eImBO1lHZAvrWlWj7GQd9nwQo7dVWRc-D4q4nh-nTZUHAYAOoO00yWUPireTAtc9TmxercfFvEfPNb2QsAP1s4r0eJpff-pJCUKeW5tfgAvQ_8XMZSgUeBfCO_UYcV1LQt5l9z5gmZQwYMqHdUYhSL3od0VdvzDjeaTN7tA Sep 09 13:02:27.290066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:02:27.290066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:02:27.290066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:02:27.290066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:02:27.290066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:02:27.290066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:02:27.290066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: bf202f6eebd442e988e0f7307950a6c8 Sep 09 13:02:27.290066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-611080032 Sep 09 13:02:27.290066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:02:27.290066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:02:27.292945 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bf202f6eebd442e988e0f7307950a6c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bf202f6eebd442e988e0f7307950a6c8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bf202f6eebd442e988e0f7307950a6c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bf202f6eebd442e988e0f7307950a6c8"}]}] Sep 09 13:02:27.292945 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-ServerRescueNegativeTestJSON-611080032 Sep 09 13:02:27.292945 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: bf202f6eebd442e988e0f7307950a6c8 Sep 09 13:02:27.292945 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-611080032 Sep 09 13:02:27.292945 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-ServerRescueNegativeTestJSON-611080032-project Sep 09 13:02:27.292945 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:02:27.292945 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:02:27.292945 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 48f14caeb8f944c6aaf27913972869c7 Sep 09 13:02:27.292945 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-ServerRescueNegativeTestJSON-611080032-project Sep 09 13:02:27.292945 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:02:27.292945 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance 54af832e-58c7-4e8c-9faf-318c9b33d2d7 could not be found. Sep 09 13:02:27.292945 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': '54af832e-58c7-4e8c-9faf-318c9b33d2d7'} Sep 09 13:02:27.293814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:02:27.293814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:27.293814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:02:27.293814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:02:27.293814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:02:27.293814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:02:27.293814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:02:27.293814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:02:27.293814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:02:27.293814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:02:27.293814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54af832e-58c7-4e8c-9faf-318c9b33d2d7 could not be found. Sep 09 13:02:27.293814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:27.293814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:27.293814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:27.293814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:27.293814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:27.293814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:27.293814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:02:27.293814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:02:27.293814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:02:27.295772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:02:27.295772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:02:27.295772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:02:27.295772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:02:27.295772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:02:27.295772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:02:27.295772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:02:27.295772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54af832e-58c7-4e8c-9faf-318c9b33d2d7 could not be found. Sep 09 13:02:27.295772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:27.295772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:27.295772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:27.295772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:27.295772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:27.295772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:27.295772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:02:27.295772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:02:27.295772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54af832e-58c7-4e8c-9faf-318c9b33d2d7 could not be found. Sep 09 13:02:27.295772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:27.297131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2530383d-810f-4a27-b208-2b0a3da720dc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Returning 404 to user: Instance 54af832e-58c7-4e8c-9faf-318c9b33d2d7 could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:02:27.297131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2530383d-810f-4a27-b208-2b0a3da720dc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7" status: 404 len: 111 microversion: 2.1 time: 0.064774 Sep 09 13:02:27.297131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 352/702] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:27 2022] GET /compute/v2.1/servers/54af832e-58c7-4e8c-9faf-318c9b33d2d7 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:02:27.301454 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2909be0a-bc78-45e0-bc88-b25a63574ace tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:27.306746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2909be0a-bc78-45e0-bc88-b25a63574ace tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:27.315563 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2909be0a-bc78-45e0-bc88-b25a63574ace tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:27.316375 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2909be0a-bc78-45e0-bc88-b25a63574ace tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:27.316998 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2909be0a-bc78-45e0-bc88-b25a63574ace tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:27.318030 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2909be0a-bc78-45e0-bc88-b25a63574ace tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:27.319154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2909be0a-bc78-45e0-bc88-b25a63574ace tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:27.319771 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2909be0a-bc78-45e0-bc88-b25a63574ace tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:27.467833 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-25e499e5-ea76-4a95-b3f3-f6cb86d265df tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "POST /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.881336 Sep 09 13:02:27.469187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 351/703] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 13:02:26 2022] POST /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811/os-volume_attachments => generated 194 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:02:27.477183 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-73e60d45-4aa3-40f0-97eb-7b2009d375ef tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '.version_select at 0x7f3182f0d940>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:27.583757 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2909be0a-bc78-45e0-bc88-b25a63574ace tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:27.594245 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2909be0a-bc78-45e0-bc88-b25a63574ace tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:27.595521 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-73e60d45-4aa3-40f0-97eb-7b2009d375ef tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1327978060" status: 202 len: 0 microversion: 2.1 time: 0.124278 Sep 09 13:02:27.596438 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 352/704] 10.222.0.46 () {58 vars in 1221 bytes} [Fri Sep 9 13:02:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1327978060 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:02:27.596918 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2909be0a-bc78-45e0-bc88-b25a63574ace tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:27.598147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2909be0a-bc78-45e0-bc88-b25a63574ace tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1714 microversion: 2.20 time: 0.303959 Sep 09 13:02:27.598721 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 353/705] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:02:27 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1714 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:02:28.253572 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-11d152d6-bc2e-4eff-8cb1-4dada69a4c09 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:28.254312 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-11d152d6-bc2e-4eff-8cb1-4dada69a4c09 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:28.262169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-11d152d6-bc2e-4eff-8cb1-4dada69a4c09 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:28.262745 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-11d152d6-bc2e-4eff-8cb1-4dada69a4c09 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:28.263346 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-11d152d6-bc2e-4eff-8cb1-4dada69a4c09 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:28.264441 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-11d152d6-bc2e-4eff-8cb1-4dada69a4c09 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:28.264921 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-11d152d6-bc2e-4eff-8cb1-4dada69a4c09 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:28.265355 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-11d152d6-bc2e-4eff-8cb1-4dada69a4c09 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:28.664055 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-11d152d6-bc2e-4eff-8cb1-4dada69a4c09 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:28.673067 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-11d152d6-bc2e-4eff-8cb1-4dada69a4c09 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1267 microversion: 2.1 time: 0.434931 Sep 09 13:02:28.674385 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 353/706] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:28 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1267 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:29.700994 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a40c0d98-5b09-4449-97e4-00cb9f7cf1d1 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:29.701710 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-a40c0d98-5b09-4449-97e4-00cb9f7cf1d1 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:29.722692 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a40c0d98-5b09-4449-97e4-00cb9f7cf1d1 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:29.745677 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a40c0d98-5b09-4449-97e4-00cb9f7cf1d1 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:29.750297 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a40c0d98-5b09-4449-97e4-00cb9f7cf1d1 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:29.751332 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a40c0d98-5b09-4449-97e4-00cb9f7cf1d1 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:29.751984 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a40c0d98-5b09-4449-97e4-00cb9f7cf1d1 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:29.753175 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a40c0d98-5b09-4449-97e4-00cb9f7cf1d1 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:29.940158 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-a40c0d98-5b09-4449-97e4-00cb9f7cf1d1 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:29.948869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-a40c0d98-5b09-4449-97e4-00cb9f7cf1d1 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1267 microversion: 2.1 time: 0.256082 Sep 09 13:02:29.949821 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 354/707] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:29 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1267 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:30.972708 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-0626b423-42db-4b6d-b0dd-f4549a92269d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:30.973322 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-0626b423-42db-4b6d-b0dd-f4549a92269d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:30.983091 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0626b423-42db-4b6d-b0dd-f4549a92269d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:30.983091 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0626b423-42db-4b6d-b0dd-f4549a92269d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:30.983091 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0626b423-42db-4b6d-b0dd-f4549a92269d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:30.983860 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0626b423-42db-4b6d-b0dd-f4549a92269d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:30.984927 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0626b423-42db-4b6d-b0dd-f4549a92269d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:30.985370 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0626b423-42db-4b6d-b0dd-f4549a92269d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:31.244536 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-0626b423-42db-4b6d-b0dd-f4549a92269d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:31.258321 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-0626b423-42db-4b6d-b0dd-f4549a92269d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1267 microversion: 2.1 time: 0.289092 Sep 09 13:02:31.258971 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 354/708] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:30 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1267 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:31.848611 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-169faf87-1e42-4a92-b1e8-f4f23ad7aef1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Action: 'create', calling method: .version_select at 0x7f318305ef70>, body: {"keypair": {"name": "tempest-TestShelveInstance-2050944839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZnUrvbCfU3zC/kz56Niwk3tEb2b/vi3eps6vTuOCFBvaXaZEglVtLiVtNsKey24B/3WRbCQH3E786TLKcDJhZZzpusGNtk0bpUdy/daQw4/pYiiyfg+rX/Ogao4fwbgQ=="}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:02:31.865006 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-169faf87-1e42-4a92-b1e8-f4f23ad7aef1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Getting quotas for project add9aa988a0848d185d4f06039cfd00e. Resources: {'key_pairs'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:02:31.869079 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-169faf87-1e42-4a92-b1e8-f4f23ad7aef1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Getting quotas for user a112ff54558147cf8739322b085fe1ab and project add9aa988a0848d185d4f06039cfd00e. Resources: {'key_pairs'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:02:31.894123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-dff57fdd-d854-41cd-9bfc-b450b606917f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:31.894655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-dff57fdd-d854-41cd-9bfc-b450b606917f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:31.901155 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dff57fdd-d854-41cd-9bfc-b450b606917f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:31.901643 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dff57fdd-d854-41cd-9bfc-b450b606917f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:31.902083 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dff57fdd-d854-41cd-9bfc-b450b606917f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:31.902878 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dff57fdd-d854-41cd-9bfc-b450b606917f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:31.903338 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dff57fdd-d854-41cd-9bfc-b450b606917f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:31.903766 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dff57fdd-d854-41cd-9bfc-b450b606917f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:31.907910 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:02:31.926741 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-169faf87-1e42-4a92-b1e8-f4f23ad7aef1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.252876 Sep 09 13:02:31.927542 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 355/709] 10.222.0.46 () {60 vars in 1159 bytes} [Fri Sep 9 13:02:31 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:02:31.930116 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-dff57fdd-d854-41cd-9bfc-b450b606917f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Going to try to terminate instance {{(pid=127772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:02:32.223171 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-dff57fdd-d854-41cd-9bfc-b450b606917f tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 204 len: 0 microversion: 2.1 time: 0.332563 Sep 09 13:02:32.223953 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 355/710] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:02:31 2022] DELETE /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 13:02:32.232602 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-b45aca89-8e1a-4db2-a0d4-09cc451193df tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:32.233147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-b45aca89-8e1a-4db2-a0d4-09cc451193df tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:32.239255 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b45aca89-8e1a-4db2-a0d4-09cc451193df tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:32.239745 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b45aca89-8e1a-4db2-a0d4-09cc451193df tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:32.240188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b45aca89-8e1a-4db2-a0d4-09cc451193df tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:32.240886 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b45aca89-8e1a-4db2-a0d4-09cc451193df tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:32.241342 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b45aca89-8e1a-4db2-a0d4-09cc451193df tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:32.241797 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b45aca89-8e1a-4db2-a0d4-09cc451193df tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:32.284465 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ad4ae7dd-f7af-47e8-abf8-5e34b1de920a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:32.284465 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-ad4ae7dd-f7af-47e8-abf8-5e34b1de920a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:32.290420 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ad4ae7dd-f7af-47e8-abf8-5e34b1de920a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:32.291421 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ad4ae7dd-f7af-47e8-abf8-5e34b1de920a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:32.291771 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ad4ae7dd-f7af-47e8-abf8-5e34b1de920a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:32.299590 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ad4ae7dd-f7af-47e8-abf8-5e34b1de920a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:32.299590 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ad4ae7dd-f7af-47e8-abf8-5e34b1de920a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:32.299590 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ad4ae7dd-f7af-47e8-abf8-5e34b1de920a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:32.393036 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-b45aca89-8e1a-4db2-a0d4-09cc451193df tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:32.402432 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-b45aca89-8e1a-4db2-a0d4-09cc451193df tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1508 microversion: 2.1 time: 0.174330 Sep 09 13:02:32.403039 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 356/711] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:32 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:32.441944 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ad4ae7dd-f7af-47e8-abf8-5e34b1de920a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:32.450847 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-ad4ae7dd-f7af-47e8-abf8-5e34b1de920a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1267 microversion: 2.1 time: 0.172655 Sep 09 13:02:32.451405 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 356/712] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:32 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:32.812413 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-7cf13080-6359-437c-a410-8efc9574beec req-0448759c-8f81-4d0b-ab0e-de29a7914601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a161d78-b95c-41f2-a747-3bc9376c5058", "name": "network-vif-plugged", "status": "completed", "tag": "be2358f4-e985-4509-9168-4b4923220982"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:02:32.828463 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-7cf13080-6359-437c-a410-8efc9574beec req-0448759c-8f81-4d0b-ab0e-de29a7914601 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:32.829049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-7cf13080-6359-437c-a410-8efc9574beec req-0448759c-8f81-4d0b-ab0e-de29a7914601 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:32.829505 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-7cf13080-6359-437c-a410-8efc9574beec req-0448759c-8f81-4d0b-ab0e-de29a7914601 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:32.842370 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-7cf13080-6359-437c-a410-8efc9574beec req-0448759c-8f81-4d0b-ab0e-de29a7914601 service nova] Creating event network-vif-plugged:be2358f4-e985-4509-9168-4b4923220982 for instance 2a161d78-b95c-41f2-a747-3bc9376c5058 on hv-cinder-81322 Sep 09 13:02:32.847408 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-7cf13080-6359-437c-a410-8efc9574beec req-0448759c-8f81-4d0b-ab0e-de29a7914601 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039120 Sep 09 13:02:32.848702 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 357/713] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:02:33.425500 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e9eb4ce9-18cc-4554-8aac-ed5eff1f0e7a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:33.426187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e9eb4ce9-18cc-4554-8aac-ed5eff1f0e7a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:33.433790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e9eb4ce9-18cc-4554-8aac-ed5eff1f0e7a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:33.434288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e9eb4ce9-18cc-4554-8aac-ed5eff1f0e7a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:33.434779 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e9eb4ce9-18cc-4554-8aac-ed5eff1f0e7a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:33.435469 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e9eb4ce9-18cc-4554-8aac-ed5eff1f0e7a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:33.435931 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e9eb4ce9-18cc-4554-8aac-ed5eff1f0e7a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:33.436363 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e9eb4ce9-18cc-4554-8aac-ed5eff1f0e7a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:33.475568 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d7521dff-2d5c-48b9-8c31-649a5649778f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:33.476686 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-d7521dff-2d5c-48b9-8c31-649a5649778f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:33.484730 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d7521dff-2d5c-48b9-8c31-649a5649778f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:33.485347 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d7521dff-2d5c-48b9-8c31-649a5649778f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:33.486007 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d7521dff-2d5c-48b9-8c31-649a5649778f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:33.486829 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d7521dff-2d5c-48b9-8c31-649a5649778f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:33.487386 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d7521dff-2d5c-48b9-8c31-649a5649778f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:33.487891 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d7521dff-2d5c-48b9-8c31-649a5649778f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:33.514089 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=100 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:02:33.596294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e9eb4ce9-18cc-4554-8aac-ed5eff1f0e7a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:33.611124 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e9eb4ce9-18cc-4554-8aac-ed5eff1f0e7a tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1508 microversion: 2.1 time: 0.189546 Sep 09 13:02:33.612130 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 357/714] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:33 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:33.693277 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-d7521dff-2d5c-48b9-8c31-649a5649778f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:33.701317 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d7521dff-2d5c-48b9-8c31-649a5649778f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1267 microversion: 2.1 time: 0.229976 Sep 09 13:02:33.701893 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 358/715] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:33 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:02:34.640170 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a78492a5-334f-418c-a3af-0a074afc1b66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:34.640864 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a78492a5-334f-418c-a3af-0a074afc1b66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:34.651156 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a78492a5-334f-418c-a3af-0a074afc1b66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:34.651794 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a78492a5-334f-418c-a3af-0a074afc1b66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:34.652283 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a78492a5-334f-418c-a3af-0a074afc1b66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:34.653100 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a78492a5-334f-418c-a3af-0a074afc1b66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:34.653582 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a78492a5-334f-418c-a3af-0a074afc1b66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:34.654097 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a78492a5-334f-418c-a3af-0a074afc1b66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:34.728522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8e8da3e7-98f9-4463-9f79-bf8cb1c7f9ff tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:34.728522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-8e8da3e7-98f9-4463-9f79-bf8cb1c7f9ff tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:34.734795 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8e8da3e7-98f9-4463-9f79-bf8cb1c7f9ff tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:34.735458 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8e8da3e7-98f9-4463-9f79-bf8cb1c7f9ff tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:34.736061 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8e8da3e7-98f9-4463-9f79-bf8cb1c7f9ff tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:34.737361 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8e8da3e7-98f9-4463-9f79-bf8cb1c7f9ff tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:34.738332 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8e8da3e7-98f9-4463-9f79-bf8cb1c7f9ff tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:34.739263 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8e8da3e7-98f9-4463-9f79-bf8cb1c7f9ff tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:34.936746 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a78492a5-334f-418c-a3af-0a074afc1b66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:34.945405 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a78492a5-334f-418c-a3af-0a074afc1b66 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1508 microversion: 2.1 time: 0.314220 Sep 09 13:02:34.949886 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 358/716] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:34 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1508 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:35.029344 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-8e8da3e7-98f9-4463-9f79-bf8cb1c7f9ff tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:35.038115 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-8e8da3e7-98f9-4463-9f79-bf8cb1c7f9ff tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1267 microversion: 2.1 time: 0.317343 Sep 09 13:02:35.039873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 359/717] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:34 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1267 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:35.772099 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-94991775-a4d9-44ce-a86c-958859098757 req-cc6b1d62-d039-44c3-9ebf-b60e552fc879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfda8e07-4c29-4614-b8a1-5311ccdcf10c", "name": "network-vif-deleted", "tag": "1d613b8e-332c-48d5-b684-1ecbdf6b6a45"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:02:35.783829 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-94991775-a4d9-44ce-a86c-958859098757 req-cc6b1d62-d039-44c3-9ebf-b60e552fc879 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:35.785528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-94991775-a4d9-44ce-a86c-958859098757 req-cc6b1d62-d039-44c3-9ebf-b60e552fc879 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:35.785528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-94991775-a4d9-44ce-a86c-958859098757 req-cc6b1d62-d039-44c3-9ebf-b60e552fc879 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:35.798141 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-94991775-a4d9-44ce-a86c-958859098757 req-cc6b1d62-d039-44c3-9ebf-b60e552fc879 service nova] Creating event network-vif-deleted:1d613b8e-332c-48d5-b684-1ecbdf6b6a45 for instance cfda8e07-4c29-4614-b8a1-5311ccdcf10c on hv-cinder-81322 Sep 09 13:02:35.804593 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-94991775-a4d9-44ce-a86c-958859098757 req-cc6b1d62-d039-44c3-9ebf-b60e552fc879 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035954 Sep 09 13:02:35.806021 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 359/718] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:02:35.973286 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d75ec1de-01d5-498b-9324-0fec07fe373c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:35.973904 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-d75ec1de-01d5-498b-9324-0fec07fe373c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:35.981012 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d75ec1de-01d5-498b-9324-0fec07fe373c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:35.981667 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d75ec1de-01d5-498b-9324-0fec07fe373c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:35.982106 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d75ec1de-01d5-498b-9324-0fec07fe373c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:35.982875 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d75ec1de-01d5-498b-9324-0fec07fe373c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:35.983348 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d75ec1de-01d5-498b-9324-0fec07fe373c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:35.983772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d75ec1de-01d5-498b-9324-0fec07fe373c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:36.052964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-d75ec1de-01d5-498b-9324-0fec07fe373c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:36.064074 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d75ec1de-01d5-498b-9324-0fec07fe373c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1466 microversion: 2.1 time: 0.094032 Sep 09 13:02:36.064726 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-51149cee-33ac-4ad6-9d7f-1d732a61ae36 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:36.064855 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 360/719] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:35 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1466 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:36.065575 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-51149cee-33ac-4ad6-9d7f-1d732a61ae36 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:36.069894 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:02:36.073313 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-51149cee-33ac-4ad6-9d7f-1d732a61ae36 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:36.073806 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-51149cee-33ac-4ad6-9d7f-1d732a61ae36 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:36.074247 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-51149cee-33ac-4ad6-9d7f-1d732a61ae36 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:36.074986 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-51149cee-33ac-4ad6-9d7f-1d732a61ae36 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:36.075441 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-51149cee-33ac-4ad6-9d7f-1d732a61ae36 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:36.075905 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-51149cee-33ac-4ad6-9d7f-1d732a61ae36 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:36.220027 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-51149cee-33ac-4ad6-9d7f-1d732a61ae36 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:36.235665 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-51149cee-33ac-4ad6-9d7f-1d732a61ae36 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1267 microversion: 2.1 time: 0.168736 Sep 09 13:02:36.235665 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 360/720] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:36 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:02:36.383521 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-717b78f2-4e20-4755-bc54-e8066cd4ab00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:36.384985 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-717b78f2-4e20-4755-bc54-e8066cd4ab00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:36.391727 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-717b78f2-4e20-4755-bc54-e8066cd4ab00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:36.392222 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-717b78f2-4e20-4755-bc54-e8066cd4ab00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:36.392689 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-717b78f2-4e20-4755-bc54-e8066cd4ab00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:36.393542 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-717b78f2-4e20-4755-bc54-e8066cd4ab00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:36.403383 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-717b78f2-4e20-4755-bc54-e8066cd4ab00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:36.403383 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-717b78f2-4e20-4755-bc54-e8066cd4ab00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:36.485549 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.objects.instance [None req-717b78f2-4e20-4755-bc54-e8066cd4ab00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lazy-loading 'services' on Instance uuid ac5e13d7-1743-4f4a-9768-51f9b57e7811 {{(pid=127771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:02:36.741350 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-717b78f2-4e20-4755-bc54-e8066cd4ab00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811/os-volume_attachments/6fac69ef-e737-43f1-975a-3270b1a0094a" status: 202 len: 0 microversion: 2.1 time: 0.362088 Sep 09 13:02:36.742187 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 361/721] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 13:02:36 2022] DELETE /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811/os-volume_attachments/6fac69ef-e737-43f1-975a-3270b1a0094a => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:02:36.751838 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-8674b7f3-3766-49b2-bda0-95fcd91d381e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:36.754011 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-8674b7f3-3766-49b2-bda0-95fcd91d381e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:36.761848 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8674b7f3-3766-49b2-bda0-95fcd91d381e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:36.762345 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8674b7f3-3766-49b2-bda0-95fcd91d381e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:36.762814 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8674b7f3-3766-49b2-bda0-95fcd91d381e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:36.763528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8674b7f3-3766-49b2-bda0-95fcd91d381e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:36.763986 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8674b7f3-3766-49b2-bda0-95fcd91d381e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:36.764412 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8674b7f3-3766-49b2-bda0-95fcd91d381e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:36.797457 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-8674b7f3-3766-49b2-bda0-95fcd91d381e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049740 Sep 09 13:02:36.798326 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 361/722] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:02:36 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:02:37.093479 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a4808d42-ea13-4a19-9331-d43d66975953 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:37.094191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-a4808d42-ea13-4a19-9331-d43d66975953 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:37.104199 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a4808d42-ea13-4a19-9331-d43d66975953 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:37.104670 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a4808d42-ea13-4a19-9331-d43d66975953 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:37.105117 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a4808d42-ea13-4a19-9331-d43d66975953 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:37.105903 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a4808d42-ea13-4a19-9331-d43d66975953 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:37.108330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a4808d42-ea13-4a19-9331-d43d66975953 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:37.108787 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a4808d42-ea13-4a19-9331-d43d66975953 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:37.148385 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a4808d42-ea13-4a19-9331-d43d66975953 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:37.148881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a4808d42-ea13-4a19-9331-d43d66975953 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:37.149325 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a4808d42-ea13-4a19-9331-d43d66975953 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:37.150295 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.objects.instance [None req-a4808d42-ea13-4a19-9331-d43d66975953 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lazy-loading 'fault' on Instance uuid cfda8e07-4c29-4614-b8a1-5311ccdcf10c {{(pid=127771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:02:37.199777 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-a4808d42-ea13-4a19-9331-d43d66975953 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:37.208023 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-a4808d42-ea13-4a19-9331-d43d66975953 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 200 len: 1312 microversion: 2.1 time: 0.118668 Sep 09 13:02:37.208648 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 362/723] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:37 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 1312 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:37.252480 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-2add1f37-d05a-4bda-8a76-6d855f6ff05f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:37.253104 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-2add1f37-d05a-4bda-8a76-6d855f6ff05f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:37.260420 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2add1f37-d05a-4bda-8a76-6d855f6ff05f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:37.260920 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2add1f37-d05a-4bda-8a76-6d855f6ff05f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:37.261365 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2add1f37-d05a-4bda-8a76-6d855f6ff05f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:37.262082 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2add1f37-d05a-4bda-8a76-6d855f6ff05f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:37.262567 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2add1f37-d05a-4bda-8a76-6d855f6ff05f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:37.263000 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2add1f37-d05a-4bda-8a76-6d855f6ff05f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:37.430964 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-2add1f37-d05a-4bda-8a76-6d855f6ff05f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:37.444146 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-2add1f37-d05a-4bda-8a76-6d855f6ff05f tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1455 microversion: 2.1 time: 0.195698 Sep 09 13:02:37.445207 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 362/724] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:37 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1455 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:37.467636 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-c4dc47cc-3f7a-4181-9d68-8e9f625996c9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:37.468369 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-c4dc47cc-3f7a-4181-9d68-8e9f625996c9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:37.475297 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c4dc47cc-3f7a-4181-9d68-8e9f625996c9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:37.475794 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c4dc47cc-3f7a-4181-9d68-8e9f625996c9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:37.476235 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c4dc47cc-3f7a-4181-9d68-8e9f625996c9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:37.477092 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c4dc47cc-3f7a-4181-9d68-8e9f625996c9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:37.477404 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c4dc47cc-3f7a-4181-9d68-8e9f625996c9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:37.477839 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c4dc47cc-3f7a-4181-9d68-8e9f625996c9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:37.615475 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-c4dc47cc-3f7a-4181-9d68-8e9f625996c9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:37.624339 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-c4dc47cc-3f7a-4181-9d68-8e9f625996c9 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1455 microversion: 2.1 time: 0.160574 Sep 09 13:02:37.624938 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 363/725] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:37 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1455 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:37.811536 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-07e2d01c-4125-421c-a864-5396e99ca4b5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:37.814395 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-07e2d01c-4125-421c-a864-5396e99ca4b5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:37.820633 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-07e2d01c-4125-421c-a864-5396e99ca4b5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:37.821123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-07e2d01c-4125-421c-a864-5396e99ca4b5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:37.821926 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-07e2d01c-4125-421c-a864-5396e99ca4b5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:37.822772 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-07e2d01c-4125-421c-a864-5396e99ca4b5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:37.828969 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-07e2d01c-4125-421c-a864-5396e99ca4b5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:37.828969 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-07e2d01c-4125-421c-a864-5396e99ca4b5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:37.864047 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-07e2d01c-4125-421c-a864-5396e99ca4b5 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057816 Sep 09 13:02:37.864618 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 363/726] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:02:37 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:02:38.234345 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e8f65493-e3c8-4305-b412-bc559fb64bc9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:38.235392 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-e8f65493-e3c8-4305-b412-bc559fb64bc9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: cfda8e07-4c29-4614-b8a1-5311ccdcf10c] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:38.244475 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e8f65493-e3c8-4305-b412-bc559fb64bc9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:38.244845 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e8f65493-e3c8-4305-b412-bc559fb64bc9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:38.245326 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e8f65493-e3c8-4305-b412-bc559fb64bc9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:38.246284 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e8f65493-e3c8-4305-b412-bc559fb64bc9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:38.246777 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e8f65493-e3c8-4305-b412-bc559fb64bc9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:38.247217 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e8f65493-e3c8-4305-b412-bc559fb64bc9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:38.269811 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-e8f65493-e3c8-4305-b412-bc559fb64bc9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] HTTP exception thrown: Instance cfda8e07-4c29-4614-b8a1-5311ccdcf10c could not be found. Sep 09 13:02:38.274188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e8f65493-e3c8-4305-b412-bc559fb64bc9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Request method failure captured: Sep 09 13:02:38.274188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c HTTP/1.1 Sep 09 13:02:38.274188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:02:38.274188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:02:38.274188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:02:38.274188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:02:38.274188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:02:38.274188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:02:38.274188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:02:38.274188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:02:38.274188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzhNsxk3eImBO1lHZAvrWlWj7GQd9nwQo7dVWRc-D4q4nh-nTZUHAYAOoO00yWUPireTAtc9TmxercfFvEfPNb2QsAP1s4r0eJpff-pJCUKeW5tfgAvQ_8XMZSgUeBfCO_UYcV1LQt5l9z5gmZQwYMqHdUYhSL3od0VdvzDjeaTN7tA Sep 09 13:02:38.274188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:02:38.274188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:02:38.274188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:02:38.274188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:02:38.274188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:02:38.274188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:02:38.274188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: bf202f6eebd442e988e0f7307950a6c8 Sep 09 13:02:38.274188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-611080032 Sep 09 13:02:38.274188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:02:38.274188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:02:38.276487 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bf202f6eebd442e988e0f7307950a6c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bf202f6eebd442e988e0f7307950a6c8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bf202f6eebd442e988e0f7307950a6c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bf202f6eebd442e988e0f7307950a6c8"}]}] Sep 09 13:02:38.276487 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-ServerRescueNegativeTestJSON-611080032 Sep 09 13:02:38.276487 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: bf202f6eebd442e988e0f7307950a6c8 Sep 09 13:02:38.276487 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-611080032 Sep 09 13:02:38.276487 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-ServerRescueNegativeTestJSON-611080032-project Sep 09 13:02:38.276487 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:02:38.276487 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:02:38.276487 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 48f14caeb8f944c6aaf27913972869c7 Sep 09 13:02:38.276487 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-ServerRescueNegativeTestJSON-611080032-project Sep 09 13:02:38.276487 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:02:38.276487 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance cfda8e07-4c29-4614-b8a1-5311ccdcf10c could not be found. Sep 09 13:02:38.276487 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': 'cfda8e07-4c29-4614-b8a1-5311ccdcf10c'} Sep 09 13:02:38.277298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:02:38.277298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:38.277298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:02:38.277298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:02:38.277298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:02:38.277298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:02:38.277298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:02:38.277298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:02:38.277298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:02:38.277298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:02:38.277298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfda8e07-4c29-4614-b8a1-5311ccdcf10c could not be found. Sep 09 13:02:38.277298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:38.277298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:38.277298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:38.277298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:38.277298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:38.277298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:38.277298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:02:38.277298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:02:38.277298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:02:38.280087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:02:38.280087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:02:38.280087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:02:38.280087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:02:38.280087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:02:38.280087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:02:38.280087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:02:38.280087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfda8e07-4c29-4614-b8a1-5311ccdcf10c could not be found. Sep 09 13:02:38.280087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:38.280087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:38.280087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:38.280087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:38.280087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:38.280087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:38.280087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:02:38.280087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:02:38.280087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfda8e07-4c29-4614-b8a1-5311ccdcf10c could not be found. Sep 09 13:02:38.280087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:38.282033 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e8f65493-e3c8-4305-b412-bc559fb64bc9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Returning 404 to user: Instance cfda8e07-4c29-4614-b8a1-5311ccdcf10c could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:02:38.282033 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-e8f65493-e3c8-4305-b412-bc559fb64bc9 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c" status: 404 len: 111 microversion: 2.1 time: 0.049272 Sep 09 13:02:38.282033 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 364/727] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:38 2022] GET /compute/v2.1/servers/cfda8e07-4c29-4614-b8a1-5311ccdcf10c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:02:38.289057 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e52d3429-63a7-41b8-9a7e-ad20756433dc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:38.289560 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e52d3429-63a7-41b8-9a7e-ad20756433dc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:38.304512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e52d3429-63a7-41b8-9a7e-ad20756433dc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:38.305021 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e52d3429-63a7-41b8-9a7e-ad20756433dc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:38.305463 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e52d3429-63a7-41b8-9a7e-ad20756433dc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:38.306259 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e52d3429-63a7-41b8-9a7e-ad20756433dc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:38.306964 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e52d3429-63a7-41b8-9a7e-ad20756433dc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:38.307404 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e52d3429-63a7-41b8-9a7e-ad20756433dc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:38.363485 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e52d3429-63a7-41b8-9a7e-ad20756433dc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Going to try to terminate instance {{(pid=127772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:02:38.687706 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e52d3429-63a7-41b8-9a7e-ad20756433dc tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 204 len: 0 microversion: 2.1 time: 0.402160 Sep 09 13:02:38.688535 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 364/728] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:02:38 2022] DELETE /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:02:38.704242 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-5a1c5c3d-6e0d-403a-92a5-f2a1e59a07d2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:38.705276 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-5a1c5c3d-6e0d-403a-92a5-f2a1e59a07d2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:38.711683 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a1c5c3d-6e0d-403a-92a5-f2a1e59a07d2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:38.712219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a1c5c3d-6e0d-403a-92a5-f2a1e59a07d2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:38.713874 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a1c5c3d-6e0d-403a-92a5-f2a1e59a07d2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:38.715612 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a1c5c3d-6e0d-403a-92a5-f2a1e59a07d2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:38.716149 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a1c5c3d-6e0d-403a-92a5-f2a1e59a07d2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:38.716677 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a1c5c3d-6e0d-403a-92a5-f2a1e59a07d2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:38.879529 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-03f1240b-855e-4f29-968c-705e388abcf3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:38.881990 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-03f1240b-855e-4f29-968c-705e388abcf3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:38.889555 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-03f1240b-855e-4f29-968c-705e388abcf3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:38.890056 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-03f1240b-855e-4f29-968c-705e388abcf3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:38.890699 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-03f1240b-855e-4f29-968c-705e388abcf3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:38.891570 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-03f1240b-855e-4f29-968c-705e388abcf3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:38.894528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-03f1240b-855e-4f29-968c-705e388abcf3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:38.894528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-03f1240b-855e-4f29-968c-705e388abcf3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:38.923374 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-03f1240b-855e-4f29-968c-705e388abcf3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049242 Sep 09 13:02:38.923938 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 365/729] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:02:38 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 13:02:38.964045 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-5a1c5c3d-6e0d-403a-92a5-f2a1e59a07d2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:38.987660 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-5a1c5c3d-6e0d-403a-92a5-f2a1e59a07d2 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.272881 Sep 09 13:02:38.988459 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 365/730] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:38 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:38.997352 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-d13b9250-1416-485f-ac38-6e5a3cfd47dc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:38.998119 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-d13b9250-1416-485f-ac38-6e5a3cfd47dc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:39.010800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d13b9250-1416-485f-ac38-6e5a3cfd47dc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:39.011300 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d13b9250-1416-485f-ac38-6e5a3cfd47dc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:39.011729 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d13b9250-1416-485f-ac38-6e5a3cfd47dc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:39.012622 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d13b9250-1416-485f-ac38-6e5a3cfd47dc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:39.013078 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d13b9250-1416-485f-ac38-6e5a3cfd47dc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:39.013497 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d13b9250-1416-485f-ac38-6e5a3cfd47dc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:39.043494 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-d13b9250-1416-485f-ac38-6e5a3cfd47dc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Going to try to terminate instance {{(pid=127772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:02:39.342732 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-d13b9250-1416-485f-ac38-6e5a3cfd47dc tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 204 len: 0 microversion: 2.1 time: 0.349882 Sep 09 13:02:39.343370 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 366/731] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:02:38 2022] DELETE /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:02:39.351746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-12f9daa8-78e9-4bdd-be0b-f7a7c4326b30 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:39.352386 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-12f9daa8-78e9-4bdd-be0b-f7a7c4326b30 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:39.361330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-12f9daa8-78e9-4bdd-be0b-f7a7c4326b30 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:39.361835 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-12f9daa8-78e9-4bdd-be0b-f7a7c4326b30 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:39.362294 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-12f9daa8-78e9-4bdd-be0b-f7a7c4326b30 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:39.363106 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-12f9daa8-78e9-4bdd-be0b-f7a7c4326b30 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:39.363568 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-12f9daa8-78e9-4bdd-be0b-f7a7c4326b30 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:39.363998 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-12f9daa8-78e9-4bdd-be0b-f7a7c4326b30 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:39.635634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-12f9daa8-78e9-4bdd-be0b-f7a7c4326b30 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:39.644553 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-12f9daa8-78e9-4bdd-be0b-f7a7c4326b30 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 200 len: 1679 microversion: 2.1 time: 0.296666 Sep 09 13:02:39.645326 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 366/732] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:39 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 1679 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:40.013604 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-91ff441d-de5b-4b3f-8f0e-cf7bd3e91580 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:40.014317 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-91ff441d-de5b-4b3f-8f0e-cf7bd3e91580 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:40.021084 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-91ff441d-de5b-4b3f-8f0e-cf7bd3e91580 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:40.021704 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-91ff441d-de5b-4b3f-8f0e-cf7bd3e91580 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:40.022167 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-91ff441d-de5b-4b3f-8f0e-cf7bd3e91580 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:40.023094 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-91ff441d-de5b-4b3f-8f0e-cf7bd3e91580 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:40.023559 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-91ff441d-de5b-4b3f-8f0e-cf7bd3e91580 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:40.024020 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-91ff441d-de5b-4b3f-8f0e-cf7bd3e91580 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:40.047570 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:02:40.168883 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-693df64d-0587-44fd-8335-d6a9785331cf req-b888b342-8790-429c-951a-01ddfe59c7eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a161d78-b95c-41f2-a747-3bc9376c5058", "tag": "be2358f4-e985-4509-9168-4b4923220982"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:02:40.178626 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-693df64d-0587-44fd-8335-d6a9785331cf req-b888b342-8790-429c-951a-01ddfe59c7eb service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:40.184458 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-693df64d-0587-44fd-8335-d6a9785331cf req-b888b342-8790-429c-951a-01ddfe59c7eb service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:40.184458 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-693df64d-0587-44fd-8335-d6a9785331cf req-b888b342-8790-429c-951a-01ddfe59c7eb service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:40.184813 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-91ff441d-de5b-4b3f-8f0e-cf7bd3e91580 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:40.191124 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-91ff441d-de5b-4b3f-8f0e-cf7bd3e91580 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.183449 Sep 09 13:02:40.194078 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-693df64d-0587-44fd-8335-d6a9785331cf req-b888b342-8790-429c-951a-01ddfe59c7eb service nova] Creating event network-changed:be2358f4-e985-4509-9168-4b4923220982 for instance 2a161d78-b95c-41f2-a747-3bc9376c5058 on hv-cinder-81322 Sep 09 13:02:40.200020 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-693df64d-0587-44fd-8335-d6a9785331cf req-b888b342-8790-429c-951a-01ddfe59c7eb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107471 Sep 09 13:02:40.200616 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 367/733] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:02:40.207622 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 367/734] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:40 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:40.670239 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-dc4fa078-a368-4fb9-b0b1-04ade2e252c1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:40.670991 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-dc4fa078-a368-4fb9-b0b1-04ade2e252c1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:40.679718 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dc4fa078-a368-4fb9-b0b1-04ade2e252c1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:40.680208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dc4fa078-a368-4fb9-b0b1-04ade2e252c1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:40.680644 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dc4fa078-a368-4fb9-b0b1-04ade2e252c1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:40.681919 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dc4fa078-a368-4fb9-b0b1-04ade2e252c1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:40.682377 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dc4fa078-a368-4fb9-b0b1-04ade2e252c1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:40.682869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dc4fa078-a368-4fb9-b0b1-04ade2e252c1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:40.826403 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-dc4fa078-a368-4fb9-b0b1-04ade2e252c1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:40.835531 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-dc4fa078-a368-4fb9-b0b1-04ade2e252c1 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 200 len: 1679 microversion: 2.1 time: 0.170105 Sep 09 13:02:40.838827 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 368/735] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:40 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:41.215719 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-f038ff04-9491-4f05-aef8-c49a8505bb86 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:41.216357 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-f038ff04-9491-4f05-aef8-c49a8505bb86 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:41.223055 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f038ff04-9491-4f05-aef8-c49a8505bb86 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:41.223539 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f038ff04-9491-4f05-aef8-c49a8505bb86 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:41.223972 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f038ff04-9491-4f05-aef8-c49a8505bb86 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:41.224656 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f038ff04-9491-4f05-aef8-c49a8505bb86 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:41.225166 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f038ff04-9491-4f05-aef8-c49a8505bb86 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:41.225606 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f038ff04-9491-4f05-aef8-c49a8505bb86 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:41.632431 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-f038ff04-9491-4f05-aef8-c49a8505bb86 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:41.640786 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-f038ff04-9491-4f05-aef8-c49a8505bb86 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.429987 Sep 09 13:02:41.643840 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 368/736] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:41 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:41.866252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-3face18e-4ce0-4443-aa0f-d2064a09db94 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:41.866252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-3face18e-4ce0-4443-aa0f-d2064a09db94 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:41.869725 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3face18e-4ce0-4443-aa0f-d2064a09db94 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:41.870235 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3face18e-4ce0-4443-aa0f-d2064a09db94 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:41.871537 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3face18e-4ce0-4443-aa0f-d2064a09db94 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:41.872253 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3face18e-4ce0-4443-aa0f-d2064a09db94 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:41.872713 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3face18e-4ce0-4443-aa0f-d2064a09db94 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:41.873187 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-3face18e-4ce0-4443-aa0f-d2064a09db94 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:41.876093 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=4 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:02:42.012937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-3face18e-4ce0-4443-aa0f-d2064a09db94 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:42.021333 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-3face18e-4ce0-4443-aa0f-d2064a09db94 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 200 len: 1679 microversion: 2.1 time: 0.164633 Sep 09 13:02:42.021907 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 369/737] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:41 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:42.664214 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a5cbea45-d85f-4458-a0cb-7893f0c8972c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:42.664824 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a5cbea45-d85f-4458-a0cb-7893f0c8972c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:42.672519 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a5cbea45-d85f-4458-a0cb-7893f0c8972c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:42.673026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a5cbea45-d85f-4458-a0cb-7893f0c8972c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:42.673472 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a5cbea45-d85f-4458-a0cb-7893f0c8972c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:42.674182 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a5cbea45-d85f-4458-a0cb-7893f0c8972c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:42.674692 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a5cbea45-d85f-4458-a0cb-7893f0c8972c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:42.675125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a5cbea45-d85f-4458-a0cb-7893f0c8972c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:42.810139 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a5cbea45-d85f-4458-a0cb-7893f0c8972c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:42.818138 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a5cbea45-d85f-4458-a0cb-7893f0c8972c tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.157735 Sep 09 13:02:42.818766 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 369/738] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:42 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:43.045100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ae06b90f-51dc-43ee-9aa3-e2d00876cd00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:43.045715 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ae06b90f-51dc-43ee-9aa3-e2d00876cd00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:43.052200 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ae06b90f-51dc-43ee-9aa3-e2d00876cd00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:43.052738 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ae06b90f-51dc-43ee-9aa3-e2d00876cd00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:43.053131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ae06b90f-51dc-43ee-9aa3-e2d00876cd00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:43.053827 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ae06b90f-51dc-43ee-9aa3-e2d00876cd00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:43.054283 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ae06b90f-51dc-43ee-9aa3-e2d00876cd00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:43.054739 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ae06b90f-51dc-43ee-9aa3-e2d00876cd00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:43.189292 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ae06b90f-51dc-43ee-9aa3-e2d00876cd00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:43.197140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ae06b90f-51dc-43ee-9aa3-e2d00876cd00 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 200 len: 1679 microversion: 2.1 time: 0.155936 Sep 09 13:02:43.197707 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 370/739] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:43 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:43.843066 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-61318c63-48f4-40db-985f-4b5de3218c41 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:43.843669 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-61318c63-48f4-40db-985f-4b5de3218c41 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:43.850040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-61318c63-48f4-40db-985f-4b5de3218c41 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:43.850675 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-61318c63-48f4-40db-985f-4b5de3218c41 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:43.851112 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-61318c63-48f4-40db-985f-4b5de3218c41 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:43.851801 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-61318c63-48f4-40db-985f-4b5de3218c41 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:43.852252 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-61318c63-48f4-40db-985f-4b5de3218c41 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:43.852682 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-61318c63-48f4-40db-985f-4b5de3218c41 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:44.221227 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-75a552ec-365d-463f-8b40-2b37879e52d2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:44.221837 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-75a552ec-365d-463f-8b40-2b37879e52d2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:44.228682 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-75a552ec-365d-463f-8b40-2b37879e52d2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:44.229235 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-75a552ec-365d-463f-8b40-2b37879e52d2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:44.230536 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-75a552ec-365d-463f-8b40-2b37879e52d2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:44.231493 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-75a552ec-365d-463f-8b40-2b37879e52d2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:44.232462 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-75a552ec-365d-463f-8b40-2b37879e52d2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:44.232585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-75a552ec-365d-463f-8b40-2b37879e52d2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:44.305884 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-61318c63-48f4-40db-985f-4b5de3218c41 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:44.307295 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-61318c63-48f4-40db-985f-4b5de3218c41 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1520 microversion: 2.1 time: 0.467991 Sep 09 13:02:44.309041 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 370/740] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:43 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1520 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:44.388347 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-75a552ec-365d-463f-8b40-2b37879e52d2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:44.400931 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-75a552ec-365d-463f-8b40-2b37879e52d2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 200 len: 1679 microversion: 2.1 time: 0.183525 Sep 09 13:02:44.401530 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 371/741] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:44 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:02:44.906366 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-6d63251d-cd9b-45fd-bd01-3a8dd7d650b9 req-d5fd52a8-1737-49bb-8d6e-4750ede6de9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d440fb7-9e24-433c-9cc5-282005be09bb", "name": "network-vif-deleted", "tag": "1af869e9-86f9-4e43-abb7-1eb79bc433a8"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:02:44.923448 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-6d63251d-cd9b-45fd-bd01-3a8dd7d650b9 req-d5fd52a8-1737-49bb-8d6e-4750ede6de9f service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:44.923934 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-6d63251d-cd9b-45fd-bd01-3a8dd7d650b9 req-d5fd52a8-1737-49bb-8d6e-4750ede6de9f service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:44.924370 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-6d63251d-cd9b-45fd-bd01-3a8dd7d650b9 req-d5fd52a8-1737-49bb-8d6e-4750ede6de9f service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:44.937116 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-6d63251d-cd9b-45fd-bd01-3a8dd7d650b9 req-d5fd52a8-1737-49bb-8d6e-4750ede6de9f service nova] Creating event network-vif-deleted:1af869e9-86f9-4e43-abb7-1eb79bc433a8 for instance 6d440fb7-9e24-433c-9cc5-282005be09bb on hv-cinder-81322 Sep 09 13:02:44.942104 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-6d63251d-cd9b-45fd-bd01-3a8dd7d650b9 req-d5fd52a8-1737-49bb-8d6e-4750ede6de9f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040038 Sep 09 13:02:44.942769 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 371/742] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:02:45.347980 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0f309a0a-90fa-4f42-b437-6e364ca45331 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:45.348939 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-0f309a0a-90fa-4f42-b437-6e364ca45331 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:45.365679 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0f309a0a-90fa-4f42-b437-6e364ca45331 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:45.369107 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0f309a0a-90fa-4f42-b437-6e364ca45331 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:45.369583 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0f309a0a-90fa-4f42-b437-6e364ca45331 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:45.370374 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0f309a0a-90fa-4f42-b437-6e364ca45331 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:45.377020 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0f309a0a-90fa-4f42-b437-6e364ca45331 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:45.377490 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0f309a0a-90fa-4f42-b437-6e364ca45331 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:45.436942 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-2faf18c4-be9b-4c24-8323-dceaa1882566 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:45.438603 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-2faf18c4-be9b-4c24-8323-dceaa1882566 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:45.448847 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0f309a0a-90fa-4f42-b437-6e364ca45331 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:45.449339 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0f309a0a-90fa-4f42-b437-6e364ca45331 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:45.452139 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2faf18c4-be9b-4c24-8323-dceaa1882566 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:45.452942 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0f309a0a-90fa-4f42-b437-6e364ca45331 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:45.453567 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.objects.instance [None req-0f309a0a-90fa-4f42-b437-6e364ca45331 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lazy-loading 'fault' on Instance uuid 6d440fb7-9e24-433c-9cc5-282005be09bb {{(pid=127771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:02:45.453742 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2faf18c4-be9b-4c24-8323-dceaa1882566 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:45.454931 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2faf18c4-be9b-4c24-8323-dceaa1882566 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:45.461737 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2faf18c4-be9b-4c24-8323-dceaa1882566 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:45.462865 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2faf18c4-be9b-4c24-8323-dceaa1882566 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:45.463535 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2faf18c4-be9b-4c24-8323-dceaa1882566 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:45.534745 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-0f309a0a-90fa-4f42-b437-6e364ca45331 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f14caeb8f944c6aaf27913972869c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf202f6eebd442e988e0f7307950a6c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:45.546023 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0f309a0a-90fa-4f42-b437-6e364ca45331 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 200 len: 1309 microversion: 2.1 time: 0.211518 Sep 09 13:02:45.557102 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 372/743] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:45 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 1309 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:45.594187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-2faf18c4-be9b-4c24-8323-dceaa1882566 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:45.603472 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-2faf18c4-be9b-4c24-8323-dceaa1882566 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 200 len: 1612 microversion: 2.1 time: 0.181908 Sep 09 13:02:45.604056 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 372/744] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:45 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 1612 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:02:46.570066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-711b7b40-9939-4603-9370-bfab24c479d7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:46.570710 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-711b7b40-9939-4603-9370-bfab24c479d7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] [instance: 6d440fb7-9e24-433c-9cc5-282005be09bb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:46.577339 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-711b7b40-9939-4603-9370-bfab24c479d7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:46.577832 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-711b7b40-9939-4603-9370-bfab24c479d7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:46.578314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-711b7b40-9939-4603-9370-bfab24c479d7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:46.579040 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-711b7b40-9939-4603-9370-bfab24c479d7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:46.579552 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-711b7b40-9939-4603-9370-bfab24c479d7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:46.579985 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-711b7b40-9939-4603-9370-bfab24c479d7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:46.594979 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-711b7b40-9939-4603-9370-bfab24c479d7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] HTTP exception thrown: Instance 6d440fb7-9e24-433c-9cc5-282005be09bb could not be found. Sep 09 13:02:46.596634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-711b7b40-9939-4603-9370-bfab24c479d7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Request method failure captured: Sep 09 13:02:46.596634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb HTTP/1.1 Sep 09 13:02:46.596634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:02:46.596634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:02:46.596634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:02:46.596634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:02:46.596634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:02:46.596634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:02:46.596634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:02:46.596634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:02:46.596634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzhNsxk3eImBO1lHZAvrWlWj7GQd9nwQo7dVWRc-D4q4nh-nTZUHAYAOoO00yWUPireTAtc9TmxercfFvEfPNb2QsAP1s4r0eJpff-pJCUKeW5tfgAvQ_8XMZSgUeBfCO_UYcV1LQt5l9z5gmZQwYMqHdUYhSL3od0VdvzDjeaTN7tA Sep 09 13:02:46.596634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:02:46.596634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:02:46.596634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:02:46.596634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:02:46.596634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:02:46.596634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:02:46.596634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: bf202f6eebd442e988e0f7307950a6c8 Sep 09 13:02:46.596634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-611080032 Sep 09 13:02:46.596634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:02:46.596634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:02:46.598159 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bf202f6eebd442e988e0f7307950a6c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bf202f6eebd442e988e0f7307950a6c8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bf202f6eebd442e988e0f7307950a6c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bf202f6eebd442e988e0f7307950a6c8"}]}] Sep 09 13:02:46.598159 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-ServerRescueNegativeTestJSON-611080032 Sep 09 13:02:46.598159 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: bf202f6eebd442e988e0f7307950a6c8 Sep 09 13:02:46.598159 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-611080032 Sep 09 13:02:46.598159 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-ServerRescueNegativeTestJSON-611080032-project Sep 09 13:02:46.598159 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:02:46.598159 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:02:46.598159 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 48f14caeb8f944c6aaf27913972869c7 Sep 09 13:02:46.598159 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-ServerRescueNegativeTestJSON-611080032-project Sep 09 13:02:46.598159 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:02:46.598159 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance 6d440fb7-9e24-433c-9cc5-282005be09bb could not be found. Sep 09 13:02:46.598159 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': '6d440fb7-9e24-433c-9cc5-282005be09bb'} Sep 09 13:02:46.599028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:02:46.599028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:46.599028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:02:46.599028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:02:46.599028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:02:46.599028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:02:46.599028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:02:46.599028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:02:46.599028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:02:46.599028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:02:46.599028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d440fb7-9e24-433c-9cc5-282005be09bb could not be found. Sep 09 13:02:46.599028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:46.599028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:46.599028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:46.599028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:46.599028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:46.599028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:46.599028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:02:46.599028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:02:46.599028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:02:46.600750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:02:46.600750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:02:46.600750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:02:46.600750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:02:46.600750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:02:46.600750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:02:46.600750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:02:46.600750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d440fb7-9e24-433c-9cc5-282005be09bb could not be found. Sep 09 13:02:46.600750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:46.600750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:46.600750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:46.600750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:46.600750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:46.600750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:46.600750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:02:46.600750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:02:46.600750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d440fb7-9e24-433c-9cc5-282005be09bb could not be found. Sep 09 13:02:46.600750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:46.602146 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-711b7b40-9939-4603-9370-bfab24c479d7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] Returning 404 to user: Instance 6d440fb7-9e24-433c-9cc5-282005be09bb could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:02:46.602146 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-711b7b40-9939-4603-9370-bfab24c479d7 tempest-ServerRescueNegativeTestJSON-611080032 tempest-ServerRescueNegativeTestJSON-611080032-project] 10.222.0.46 "GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb" status: 404 len: 111 microversion: 2.1 time: 0.032018 Sep 09 13:02:46.602146 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 373/745] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:46 2022] GET /compute/v2.1/servers/6d440fb7-9e24-433c-9cc5-282005be09bb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:02:46.629124 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-293e5ce8-841f-44d6-bc53-753f1cb5b186 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:46.629996 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-293e5ce8-841f-44d6-bc53-753f1cb5b186 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:46.636366 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-293e5ce8-841f-44d6-bc53-753f1cb5b186 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:46.637202 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-293e5ce8-841f-44d6-bc53-753f1cb5b186 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:46.638335 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-293e5ce8-841f-44d6-bc53-753f1cb5b186 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:46.639049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-293e5ce8-841f-44d6-bc53-753f1cb5b186 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:46.639505 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-293e5ce8-841f-44d6-bc53-753f1cb5b186 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:46.639942 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-293e5ce8-841f-44d6-bc53-753f1cb5b186 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:46.698069 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-293e5ce8-841f-44d6-bc53-753f1cb5b186 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:46.698716 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-293e5ce8-841f-44d6-bc53-753f1cb5b186 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:46.699432 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-293e5ce8-841f-44d6-bc53-753f1cb5b186 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:46.704977 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.objects.instance [None req-293e5ce8-841f-44d6-bc53-753f1cb5b186 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lazy-loading 'fault' on Instance uuid ac5e13d7-1743-4f4a-9768-51f9b57e7811 {{(pid=127772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:02:46.753747 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-293e5ce8-841f-44d6-bc53-753f1cb5b186 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a2902f465f4fd1aed80060c2669259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceed6a1f0f4542cbafa4b2a46b16d5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:46.761950 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-293e5ce8-841f-44d6-bc53-753f1cb5b186 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 200 len: 1330 microversion: 2.1 time: 0.138220 Sep 09 13:02:46.762816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 373/746] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:46 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 1330 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:46.957558 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-06bbf6fc-16a6-4c80-865f-dbdc84841646 req-97ea9794-88d3-4158-873e-7a1879b03dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac5e13d7-1743-4f4a-9768-51f9b57e7811", "name": "network-vif-deleted", "tag": "a0f07801-d4b2-4e0d-ad5d-be7c875c2cca"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:02:46.967439 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-06bbf6fc-16a6-4c80-865f-dbdc84841646 req-97ea9794-88d3-4158-873e-7a1879b03dd7 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:46.967966 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-06bbf6fc-16a6-4c80-865f-dbdc84841646 req-97ea9794-88d3-4158-873e-7a1879b03dd7 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:46.968394 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-06bbf6fc-16a6-4c80-865f-dbdc84841646 req-97ea9794-88d3-4158-873e-7a1879b03dd7 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:46.979427 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-06bbf6fc-16a6-4c80-865f-dbdc84841646 req-97ea9794-88d3-4158-873e-7a1879b03dd7 service nova] Creating event network-vif-deleted:a0f07801-d4b2-4e0d-ad5d-be7c875c2cca for instance ac5e13d7-1743-4f4a-9768-51f9b57e7811 on hv-cinder-81322 Sep 09 13:02:46.984858 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-06bbf6fc-16a6-4c80-865f-dbdc84841646 req-97ea9794-88d3-4158-873e-7a1879b03dd7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031078 Sep 09 13:02:46.985528 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 374/747] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:02:47.786682 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-856cb388-a6c0-4d62-a98a-0aa43472e4c2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:47.787402 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-856cb388-a6c0-4d62-a98a-0aa43472e4c2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:47.794765 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-856cb388-a6c0-4d62-a98a-0aa43472e4c2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:47.795344 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-856cb388-a6c0-4d62-a98a-0aa43472e4c2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:47.795846 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-856cb388-a6c0-4d62-a98a-0aa43472e4c2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:47.796611 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-856cb388-a6c0-4d62-a98a-0aa43472e4c2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:47.797237 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-856cb388-a6c0-4d62-a98a-0aa43472e4c2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:47.797667 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-856cb388-a6c0-4d62-a98a-0aa43472e4c2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:47.815127 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-856cb388-a6c0-4d62-a98a-0aa43472e4c2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] HTTP exception thrown: Instance ac5e13d7-1743-4f4a-9768-51f9b57e7811 could not be found. Sep 09 13:02:47.816877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-856cb388-a6c0-4d62-a98a-0aa43472e4c2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Request method failure captured: Sep 09 13:02:47.816877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 HTTP/1.1 Sep 09 13:02:47.816877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 13:02:47.816877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 13:02:47.816877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 13:02:47.816877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 13:02:47.816877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 13:02:47.816877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 13:02:47.816877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 13:02:47.816877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 13:02:47.816877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGzgEaKb6PZCqo9yxUSEJiFD1xb1LGODlWVgID9cA22eqBLNomTmu2q0yMgjccpW69nnUAUWKXMpFaG8X-sF87AhuIdLNOF9PvF4tjoZWf7SNwd1H5TWSvp_IUIt9lOp_NKX-JRPFLgnDrNAvr9jG5GRaXTb0sVN8rNo6hRRXay_HW10 Sep 09 13:02:47.816877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 13:02:47.816877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 13:02:47.816877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 13:02:47.816877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 13:02:47.816877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 13:02:47.816877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 13:02:47.816877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:02:47.816877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:47.816877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 13:02:47.816877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 13:02:47.818569 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ceed6a1f0f4542cbafa4b2a46b16d5fb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}] Sep 09 13:02:47.818569 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:47.818569 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:02:47.818569 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:47.818569 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:02:47.818569 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 13:02:47.818569 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 13:02:47.818569 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: 63a2902f465f4fd1aed80060c2669259 Sep 09 13:02:47.818569 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:02:47.818569 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: > Sep 09 13:02:47.818569 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Instance ac5e13d7-1743-4f4a-9768-51f9b57e7811 could not be found. Sep 09 13:02:47.818569 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'id': 'ac5e13d7-1743-4f4a-9768-51f9b57e7811'} Sep 09 13:02:47.819530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:02:47.819530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:47.819530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:02:47.819530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:02:47.819530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:02:47.819530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:02:47.819530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:02:47.819530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:02:47.819530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:02:47.819530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:02:47.819530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac5e13d7-1743-4f4a-9768-51f9b57e7811 could not be found. Sep 09 13:02:47.819530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:02:47.819530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:47.819530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:02:47.819530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:47.819530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:47.819530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:47.819530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:02:47.819530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:02:47.819530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:02:47.820999 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:02:47.820999 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:02:47.820999 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:02:47.820999 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:02:47.820999 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:02:47.820999 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:02:47.820999 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:02:47.820999 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac5e13d7-1743-4f4a-9768-51f9b57e7811 could not be found. Sep 09 13:02:47.820999 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:02:47.820999 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:47.820999 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:02:47.820999 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:47.820999 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:47.820999 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:47.820999 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:02:47.820999 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:02:47.820999 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac5e13d7-1743-4f4a-9768-51f9b57e7811 could not be found. Sep 09 13:02:47.820999 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:02:47.822373 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-856cb388-a6c0-4d62-a98a-0aa43472e4c2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Returning 404 to user: Instance ac5e13d7-1743-4f4a-9768-51f9b57e7811 could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:02:47.822373 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-856cb388-a6c0-4d62-a98a-0aa43472e4c2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 404 len: 111 microversion: 2.1 time: 0.035654 Sep 09 13:02:47.823131 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 374/748] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:47 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:02:47.829553 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a1f6d97a-b13e-4baf-b4db-00872f92ad7d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '.version_select at 0x7f3182f2df70>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:48.143540 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-a1f6d97a-b13e-4baf-b4db-00872f92ad7d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1071731942" status: 202 len: 0 microversion: 2.1 time: 0.318191 Sep 09 13:02:48.144298 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 375/749] 10.222.0.46 () {58 vars in 1221 bytes} [Fri Sep 9 13:02:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1071731942 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:02:50.534093 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e484be01-7c94-4cf2-86d0-b1809ac0168e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:50.535264 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e484be01-7c94-4cf2-86d0-b1809ac0168e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:50.544305 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e484be01-7c94-4cf2-86d0-b1809ac0168e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:50.548379 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e484be01-7c94-4cf2-86d0-b1809ac0168e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:50.548379 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e484be01-7c94-4cf2-86d0-b1809ac0168e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:50.548379 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e484be01-7c94-4cf2-86d0-b1809ac0168e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:50.548379 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e484be01-7c94-4cf2-86d0-b1809ac0168e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:50.549295 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e484be01-7c94-4cf2-86d0-b1809ac0168e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:50.564533 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-e484be01-7c94-4cf2-86d0-b1809ac0168e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] HTTP exception thrown: Instance ac5e13d7-1743-4f4a-9768-51f9b57e7811 could not be found. Sep 09 13:02:50.566076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e484be01-7c94-4cf2-86d0-b1809ac0168e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Request method failure captured: Sep 09 13:02:50.566076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: DELETE /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 HTTP/1.1 Sep 09 13:02:50.566076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 13:02:50.566076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 13:02:50.566076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 13:02:50.566076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 13:02:50.566076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 13:02:50.566076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 13:02:50.566076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 13:02:50.566076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 13:02:50.566076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGzgEaKb6PZCqo9yxUSEJiFD1xb1LGODlWVgID9cA22eqBLNomTmu2q0yMgjccpW69nnUAUWKXMpFaG8X-sF87AhuIdLNOF9PvF4tjoZWf7SNwd1H5TWSvp_IUIt9lOp_NKX-JRPFLgnDrNAvr9jG5GRaXTb0sVN8rNo6hRRXay_HW10 Sep 09 13:02:50.566076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 13:02:50.566076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 13:02:50.566076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 13:02:50.566076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 13:02:50.566076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 13:02:50.566076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 13:02:50.566076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:02:50.566076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:50.566076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 13:02:50.566076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 13:02:50.567576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ceed6a1f0f4542cbafa4b2a46b16d5fb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}] Sep 09 13:02:50.567576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:50.567576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:02:50.567576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:50.567576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:02:50.567576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 13:02:50.567576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 13:02:50.567576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: 63a2902f465f4fd1aed80060c2669259 Sep 09 13:02:50.567576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:02:50.567576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: > Sep 09 13:02:50.567576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Instance ac5e13d7-1743-4f4a-9768-51f9b57e7811 could not be found. Sep 09 13:02:50.567576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'id': 'ac5e13d7-1743-4f4a-9768-51f9b57e7811'} Sep 09 13:02:50.568436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:02:50.568436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:50.568436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:02:50.568436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:02:50.568436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:02:50.568436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:02:50.568436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:02:50.568436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:02:50.568436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:02:50.568436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:02:50.568436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac5e13d7-1743-4f4a-9768-51f9b57e7811 could not be found. Sep 09 13:02:50.568436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:02:50.568436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:50.568436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:02:50.568436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:50.568436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:50.568436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:50.568436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:02:50.568436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:02:50.568436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:02:50.570377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:02:50.570377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 13:02:50.570377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 13:02:50.570377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 13:02:50.570377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 13:02:50.570377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:02:50.570377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:02:50.570377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:02:50.570377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:02:50.570377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac5e13d7-1743-4f4a-9768-51f9b57e7811 could not be found. Sep 09 13:02:50.570377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:02:50.570377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:50.570377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:02:50.570377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:50.570377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:50.570377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:50.570377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:02:50.570377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:02:50.570377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac5e13d7-1743-4f4a-9768-51f9b57e7811 could not be found. Sep 09 13:02:50.570377 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:02:50.578224 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e484be01-7c94-4cf2-86d0-b1809ac0168e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Returning 404 to user: Instance ac5e13d7-1743-4f4a-9768-51f9b57e7811 could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:02:50.578224 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e484be01-7c94-4cf2-86d0-b1809ac0168e tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 404 len: 111 microversion: 2.1 time: 0.037302 Sep 09 13:02:50.578224 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 375/750] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:02:50 2022] DELETE /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:02:50.584316 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-9e22cc6d-6c12-40a6-9bad-94ffccb32f98 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:50.585052 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-9e22cc6d-6c12-40a6-9bad-94ffccb32f98 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: ac5e13d7-1743-4f4a-9768-51f9b57e7811] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:50.594470 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9e22cc6d-6c12-40a6-9bad-94ffccb32f98 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:50.595045 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9e22cc6d-6c12-40a6-9bad-94ffccb32f98 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:50.595675 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9e22cc6d-6c12-40a6-9bad-94ffccb32f98 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:50.596402 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9e22cc6d-6c12-40a6-9bad-94ffccb32f98 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:50.596882 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9e22cc6d-6c12-40a6-9bad-94ffccb32f98 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:50.597306 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9e22cc6d-6c12-40a6-9bad-94ffccb32f98 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:50.614393 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-9e22cc6d-6c12-40a6-9bad-94ffccb32f98 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] HTTP exception thrown: Instance ac5e13d7-1743-4f4a-9768-51f9b57e7811 could not be found. Sep 09 13:02:50.617243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-9e22cc6d-6c12-40a6-9bad-94ffccb32f98 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Request method failure captured: Sep 09 13:02:50.617243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 HTTP/1.1 Sep 09 13:02:50.617243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:02:50.617243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:02:50.617243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:02:50.617243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:02:50.617243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:02:50.617243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:02:50.617243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:02:50.617243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:02:50.617243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzgEaKb6PZCqo9yxUSEJiFD1xb1LGODlWVgID9cA22eqBLNomTmu2q0yMgjccpW69nnUAUWKXMpFaG8X-sF87AhuIdLNOF9PvF4tjoZWf7SNwd1H5TWSvp_IUIt9lOp_NKX-JRPFLgnDrNAvr9jG5GRaXTb0sVN8rNo6hRRXay_HW10 Sep 09 13:02:50.617243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:02:50.617243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:02:50.617243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:02:50.617243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:02:50.617243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:02:50.617243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:02:50.617243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:02:50.617243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:50.617243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:02:50.617243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:02:50.618612 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ceed6a1f0f4542cbafa4b2a46b16d5fb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}] Sep 09 13:02:50.618612 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:50.618612 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:02:50.618612 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:50.618612 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:02:50.618612 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:02:50.618612 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:02:50.618612 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 63a2902f465f4fd1aed80060c2669259 Sep 09 13:02:50.618612 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:02:50.618612 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:02:50.618612 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance ac5e13d7-1743-4f4a-9768-51f9b57e7811 could not be found. Sep 09 13:02:50.618612 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': 'ac5e13d7-1743-4f4a-9768-51f9b57e7811'} Sep 09 13:02:50.619371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:02:50.619371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:50.619371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:02:50.619371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:02:50.619371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:02:50.619371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:02:50.619371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:02:50.619371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:02:50.619371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:02:50.619371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:02:50.619371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac5e13d7-1743-4f4a-9768-51f9b57e7811 could not be found. Sep 09 13:02:50.619371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:50.619371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:50.619371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:50.619371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:50.619371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:50.619371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:50.619371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:02:50.619371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:02:50.619371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:02:50.621095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:02:50.621095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:02:50.621095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:02:50.621095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:02:50.621095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:02:50.621095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:02:50.621095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:02:50.621095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac5e13d7-1743-4f4a-9768-51f9b57e7811 could not be found. Sep 09 13:02:50.621095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:50.621095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:50.621095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:50.621095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:50.621095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:50.621095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:50.621095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:02:50.621095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:02:50.621095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac5e13d7-1743-4f4a-9768-51f9b57e7811 could not be found. Sep 09 13:02:50.621095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:50.622429 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-9e22cc6d-6c12-40a6-9bad-94ffccb32f98 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Returning 404 to user: Instance ac5e13d7-1743-4f4a-9768-51f9b57e7811 could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:02:50.622429 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-9e22cc6d-6c12-40a6-9bad-94ffccb32f98 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811" status: 404 len: 111 microversion: 2.1 time: 0.039121 Sep 09 13:02:50.624543 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 376/751] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:50 2022] GET /compute/v2.1/servers/ac5e13d7-1743-4f4a-9768-51f9b57e7811 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:02:51.812362 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-6f3ef197-5a10-4a81-be3c-84785f5d3115 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1566912454", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2050944839", "security_groups": [{"name": "tempest-secgroup-smoke-27337919"}], "networks": [{"uuid": "2d9a2d07-6156-4eff-8031-23db4a9d0557"}], "block_device_mapping_v2": [{"uuid": "d1a77d6a-e6ac-4802-b557-eaaab585596e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:02:51.889881 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-acff8f7d-1e85-4172-ac54-cd5839a122a3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:51.892782 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-acff8f7d-1e85-4172-ac54-cd5839a122a3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:51.897632 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-acff8f7d-1e85-4172-ac54-cd5839a122a3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:51.898193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-acff8f7d-1e85-4172-ac54-cd5839a122a3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:51.898776 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-acff8f7d-1e85-4172-ac54-cd5839a122a3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:51.899588 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-acff8f7d-1e85-4172-ac54-cd5839a122a3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:51.900260 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-acff8f7d-1e85-4172-ac54-cd5839a122a3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:51.900835 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-acff8f7d-1e85-4172-ac54-cd5839a122a3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:51.926817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-acff8f7d-1e85-4172-ac54-cd5839a122a3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] HTTP exception thrown: Instance cfc21374-47be-4788-8ba9-e2f77ae73d6e could not be found. Sep 09 13:02:51.926817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-acff8f7d-1e85-4172-ac54-cd5839a122a3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Request method failure captured: Sep 09 13:02:51.926817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: DELETE /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e HTTP/1.1 Sep 09 13:02:51.926817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:02:51.926817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:02:51.926817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:02:51.926817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:02:51.926817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:02:51.926817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:02:51.926817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:02:51.926817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:02:51.926817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzgEaKb6PZCqo9yxUSEJiFD1xb1LGODlWVgID9cA22eqBLNomTmu2q0yMgjccpW69nnUAUWKXMpFaG8X-sF87AhuIdLNOF9PvF4tjoZWf7SNwd1H5TWSvp_IUIt9lOp_NKX-JRPFLgnDrNAvr9jG5GRaXTb0sVN8rNo6hRRXay_HW10 Sep 09 13:02:51.926817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:02:51.926817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:02:51.926817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:02:51.926817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:02:51.926817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:02:51.926817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:02:51.926817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:02:51.926817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:51.926817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:02:51.926817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:02:51.928420 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ceed6a1f0f4542cbafa4b2a46b16d5fb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}] Sep 09 13:02:51.928420 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:51.928420 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:02:51.928420 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:51.928420 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:02:51.928420 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:02:51.928420 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:02:51.928420 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 63a2902f465f4fd1aed80060c2669259 Sep 09 13:02:51.928420 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:02:51.928420 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:02:51.928420 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance cfc21374-47be-4788-8ba9-e2f77ae73d6e could not be found. Sep 09 13:02:51.928420 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': 'cfc21374-47be-4788-8ba9-e2f77ae73d6e'} Sep 09 13:02:51.929314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:02:51.929314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:51.929314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:02:51.929314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:02:51.929314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:02:51.929314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:02:51.929314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:02:51.929314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:02:51.929314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:02:51.929314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:02:51.929314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfc21374-47be-4788-8ba9-e2f77ae73d6e could not be found. Sep 09 13:02:51.929314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:51.929314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:51.929314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:51.929314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:51.929314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:51.929314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:51.929314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:02:51.929314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:02:51.929314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:02:51.931191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:02:51.931191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 13:02:51.931191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 13:02:51.931191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 13:02:51.931191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 13:02:51.931191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:02:51.931191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:02:51.931191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:02:51.931191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:02:51.931191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfc21374-47be-4788-8ba9-e2f77ae73d6e could not be found. Sep 09 13:02:51.931191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:51.931191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:51.931191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:51.931191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:51.931191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:51.931191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:51.931191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:02:51.931191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:02:51.931191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfc21374-47be-4788-8ba9-e2f77ae73d6e could not be found. Sep 09 13:02:51.931191 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:51.932781 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-acff8f7d-1e85-4172-ac54-cd5839a122a3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Returning 404 to user: Instance cfc21374-47be-4788-8ba9-e2f77ae73d6e could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:02:51.932781 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-acff8f7d-1e85-4172-ac54-cd5839a122a3 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e" status: 404 len: 111 microversion: 2.1 time: 0.034158 Sep 09 13:02:51.932781 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 377/752] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:02:51 2022] DELETE /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:02:51.932781 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-30d4cdc3-7e99-4275-9400-21dbf72823e0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:51.933278 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-30d4cdc3-7e99-4275-9400-21dbf72823e0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: cfc21374-47be-4788-8ba9-e2f77ae73d6e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:51.940648 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-30d4cdc3-7e99-4275-9400-21dbf72823e0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:51.942691 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.network.neutron [None req-6f3ef197-5a10-4a81-be3c-84785f5d3115 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] validate_networks() for [('2d9a2d07-6156-4eff-8031-23db4a9d0557', None, None, None, None, None)] {{(pid=127772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:02:51.947759 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-30d4cdc3-7e99-4275-9400-21dbf72823e0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:51.947910 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-30d4cdc3-7e99-4275-9400-21dbf72823e0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:51.948761 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-30d4cdc3-7e99-4275-9400-21dbf72823e0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:51.949302 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-30d4cdc3-7e99-4275-9400-21dbf72823e0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:51.949748 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-30d4cdc3-7e99-4275-9400-21dbf72823e0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:51.967529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-30d4cdc3-7e99-4275-9400-21dbf72823e0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] HTTP exception thrown: Instance cfc21374-47be-4788-8ba9-e2f77ae73d6e could not be found. Sep 09 13:02:51.979098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-30d4cdc3-7e99-4275-9400-21dbf72823e0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Request method failure captured: Sep 09 13:02:51.979098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e HTTP/1.1 Sep 09 13:02:51.979098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:02:51.979098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:02:51.979098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:02:51.979098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:02:51.979098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:02:51.979098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:02:51.979098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:02:51.979098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:02:51.979098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzgEaKb6PZCqo9yxUSEJiFD1xb1LGODlWVgID9cA22eqBLNomTmu2q0yMgjccpW69nnUAUWKXMpFaG8X-sF87AhuIdLNOF9PvF4tjoZWf7SNwd1H5TWSvp_IUIt9lOp_NKX-JRPFLgnDrNAvr9jG5GRaXTb0sVN8rNo6hRRXay_HW10 Sep 09 13:02:51.979098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:02:51.979098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:02:51.979098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:02:51.979098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:02:51.979098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:02:51.979098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:02:51.979098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:02:51.979098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:51.979098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:02:51.979098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:02:51.981670 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ceed6a1f0f4542cbafa4b2a46b16d5fb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}] Sep 09 13:02:51.981670 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:51.981670 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:02:51.981670 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:51.981670 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:02:51.981670 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:02:51.981670 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:02:51.981670 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 63a2902f465f4fd1aed80060c2669259 Sep 09 13:02:51.981670 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:02:51.981670 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:02:51.981670 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance cfc21374-47be-4788-8ba9-e2f77ae73d6e could not be found. Sep 09 13:02:51.981670 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': 'cfc21374-47be-4788-8ba9-e2f77ae73d6e'} Sep 09 13:02:51.982818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:02:51.982818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:51.982818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:02:51.982818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:02:51.982818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:02:51.982818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:02:51.982818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:02:51.982818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:02:51.982818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:02:51.982818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:02:51.982818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfc21374-47be-4788-8ba9-e2f77ae73d6e could not be found. Sep 09 13:02:51.982818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:51.982818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:51.982818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:51.982818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:51.982818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:51.982818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:51.982818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:02:51.982818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:02:51.982818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:02:51.984287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:02:51.984287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:02:51.984287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:02:51.984287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:02:51.984287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:02:51.984287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:02:51.984287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:02:51.984287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfc21374-47be-4788-8ba9-e2f77ae73d6e could not be found. Sep 09 13:02:51.984287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:51.984287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:51.984287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:51.984287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:51.984287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:51.984287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:51.984287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:02:51.984287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:02:51.984287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfc21374-47be-4788-8ba9-e2f77ae73d6e could not be found. Sep 09 13:02:51.984287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:51.985562 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-30d4cdc3-7e99-4275-9400-21dbf72823e0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Returning 404 to user: Instance cfc21374-47be-4788-8ba9-e2f77ae73d6e could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:02:51.985562 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-30d4cdc3-7e99-4275-9400-21dbf72823e0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e" status: 404 len: 111 microversion: 2.1 time: 0.042533 Sep 09 13:02:51.985562 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 378/753] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:51 2022] GET /compute/v2.1/servers/cfc21374-47be-4788-8ba9-e2f77ae73d6e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 13:02:51.985562 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-52608fce-a1e4-47dc-b729-ea42991ba0ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:51.985562 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-52608fce-a1e4-47dc-b729-ea42991ba0ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:51.990698 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52608fce-a1e4-47dc-b729-ea42991ba0ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:51.991299 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52608fce-a1e4-47dc-b729-ea42991ba0ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:51.991847 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52608fce-a1e4-47dc-b729-ea42991ba0ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:51.992524 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52608fce-a1e4-47dc-b729-ea42991ba0ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:51.992960 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52608fce-a1e4-47dc-b729-ea42991ba0ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:51.993313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52608fce-a1e4-47dc-b729-ea42991ba0ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:52.007419 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-52608fce-a1e4-47dc-b729-ea42991ba0ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] HTTP exception thrown: Instance 1da39a54-b8f3-49a7-9447-497fadd2cefb could not be found. Sep 09 13:02:52.008873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-52608fce-a1e4-47dc-b729-ea42991ba0ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Request method failure captured: Sep 09 13:02:52.008873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: DELETE /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb HTTP/1.1 Sep 09 13:02:52.008873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:02:52.008873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:02:52.008873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:02:52.008873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:02:52.008873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:02:52.008873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:02:52.008873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:02:52.008873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:02:52.008873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzgEaKb6PZCqo9yxUSEJiFD1xb1LGODlWVgID9cA22eqBLNomTmu2q0yMgjccpW69nnUAUWKXMpFaG8X-sF87AhuIdLNOF9PvF4tjoZWf7SNwd1H5TWSvp_IUIt9lOp_NKX-JRPFLgnDrNAvr9jG5GRaXTb0sVN8rNo6hRRXay_HW10 Sep 09 13:02:52.008873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:02:52.008873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:02:52.008873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:02:52.008873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:02:52.008873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:02:52.008873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:02:52.008873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:02:52.008873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:52.008873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:02:52.008873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:02:52.010440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ceed6a1f0f4542cbafa4b2a46b16d5fb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}] Sep 09 13:02:52.010440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:52.010440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:02:52.010440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:52.010440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:02:52.010440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:02:52.010440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:02:52.010440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 63a2902f465f4fd1aed80060c2669259 Sep 09 13:02:52.010440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:02:52.010440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:02:52.010440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance 1da39a54-b8f3-49a7-9447-497fadd2cefb could not be found. Sep 09 13:02:52.010440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': '1da39a54-b8f3-49a7-9447-497fadd2cefb'} Sep 09 13:02:52.011313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:02:52.011313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:52.011313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:02:52.011313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:02:52.011313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:02:52.011313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:02:52.011313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:02:52.011313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:02:52.011313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:02:52.011313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:02:52.011313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1da39a54-b8f3-49a7-9447-497fadd2cefb could not be found. Sep 09 13:02:52.011313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:52.011313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:52.011313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:52.011313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:52.011313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:52.011313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:52.011313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:02:52.011313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:02:52.011313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:02:52.013249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:02:52.013249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 13:02:52.013249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 13:02:52.013249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 13:02:52.013249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 13:02:52.013249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:02:52.013249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:02:52.013249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:02:52.013249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:02:52.013249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1da39a54-b8f3-49a7-9447-497fadd2cefb could not be found. Sep 09 13:02:52.013249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:52.013249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:52.013249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:52.013249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:52.013249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:52.013249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:52.013249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:02:52.013249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:02:52.013249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1da39a54-b8f3-49a7-9447-497fadd2cefb could not be found. Sep 09 13:02:52.013249 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:52.014725 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-52608fce-a1e4-47dc-b729-ea42991ba0ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Returning 404 to user: Instance 1da39a54-b8f3-49a7-9447-497fadd2cefb could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:02:52.014725 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-52608fce-a1e4-47dc-b729-ea42991ba0ca tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 404 len: 111 microversion: 2.1 time: 0.034787 Sep 09 13:02:52.014725 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 379/754] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:02:51 2022] DELETE /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 13:02:52.019307 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8c246f51-0574-4cdc-994a-356739a0a90d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:52.019991 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-8c246f51-0574-4cdc-994a-356739a0a90d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 1da39a54-b8f3-49a7-9447-497fadd2cefb] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:52.026082 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8c246f51-0574-4cdc-994a-356739a0a90d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:52.026718 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8c246f51-0574-4cdc-994a-356739a0a90d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:52.028118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8c246f51-0574-4cdc-994a-356739a0a90d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:52.028926 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8c246f51-0574-4cdc-994a-356739a0a90d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:52.029471 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8c246f51-0574-4cdc-994a-356739a0a90d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:52.029988 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8c246f51-0574-4cdc-994a-356739a0a90d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:52.034347 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:02:52.045599 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-8c246f51-0574-4cdc-994a-356739a0a90d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] HTTP exception thrown: Instance 1da39a54-b8f3-49a7-9447-497fadd2cefb could not be found. Sep 09 13:02:52.047266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8c246f51-0574-4cdc-994a-356739a0a90d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Request method failure captured: Sep 09 13:02:52.047266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb HTTP/1.1 Sep 09 13:02:52.047266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:02:52.047266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:02:52.047266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:02:52.047266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:02:52.047266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:02:52.047266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:02:52.047266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:02:52.047266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:02:52.047266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzgEaKb6PZCqo9yxUSEJiFD1xb1LGODlWVgID9cA22eqBLNomTmu2q0yMgjccpW69nnUAUWKXMpFaG8X-sF87AhuIdLNOF9PvF4tjoZWf7SNwd1H5TWSvp_IUIt9lOp_NKX-JRPFLgnDrNAvr9jG5GRaXTb0sVN8rNo6hRRXay_HW10 Sep 09 13:02:52.047266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:02:52.047266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:02:52.047266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:02:52.047266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:02:52.047266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:02:52.047266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:02:52.047266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:02:52.047266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:52.047266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:02:52.047266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:02:52.048870 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ceed6a1f0f4542cbafa4b2a46b16d5fb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}] Sep 09 13:02:52.048870 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:52.048870 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:02:52.048870 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:52.048870 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:02:52.048870 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:02:52.048870 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:02:52.048870 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 63a2902f465f4fd1aed80060c2669259 Sep 09 13:02:52.048870 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:02:52.048870 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:02:52.048870 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance 1da39a54-b8f3-49a7-9447-497fadd2cefb could not be found. Sep 09 13:02:52.048870 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': '1da39a54-b8f3-49a7-9447-497fadd2cefb'} Sep 09 13:02:52.049743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:02:52.049743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:52.049743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:02:52.049743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:02:52.049743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:02:52.049743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:02:52.049743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:02:52.049743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:02:52.049743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:02:52.049743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:02:52.049743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1da39a54-b8f3-49a7-9447-497fadd2cefb could not be found. Sep 09 13:02:52.049743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:52.049743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:52.049743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:52.049743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:52.049743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:52.049743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:52.049743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:02:52.049743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:02:52.049743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:02:52.051188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:02:52.051188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:02:52.051188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:02:52.051188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:02:52.051188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:02:52.051188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:02:52.051188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:02:52.051188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1da39a54-b8f3-49a7-9447-497fadd2cefb could not be found. Sep 09 13:02:52.051188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:52.051188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:52.051188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:52.051188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:52.051188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:52.051188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:52.051188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:02:52.051188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:02:52.051188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1da39a54-b8f3-49a7-9447-497fadd2cefb could not be found. Sep 09 13:02:52.051188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:52.052371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8c246f51-0574-4cdc-994a-356739a0a90d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Returning 404 to user: Instance 1da39a54-b8f3-49a7-9447-497fadd2cefb could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:02:52.052371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-8c246f51-0574-4cdc-994a-356739a0a90d tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb" status: 404 len: 111 microversion: 2.1 time: 0.034487 Sep 09 13:02:52.052371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 380/755] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:52 2022] GET /compute/v2.1/servers/1da39a54-b8f3-49a7-9447-497fadd2cefb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 13:02:52.358186 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-6f3ef197-5a10-4a81-be3c-84785f5d3115 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Flavor limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:02:52.358646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-6f3ef197-5a10-4a81-be3c-84785f5d3115 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Image limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:02:52.359129 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-6f3ef197-5a10-4a81-be3c-84785f5d3115 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Flavor pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:02:52.359543 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-6f3ef197-5a10-4a81-be3c-84785f5d3115 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Image pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:02:52.359958 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-6f3ef197-5a10-4a81-be3c-84785f5d3115 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:02:52.368965 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6f3ef197-5a10-4a81-be3c-84785f5d3115 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:52.369447 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6f3ef197-5a10-4a81-be3c-84785f5d3115 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:52.369885 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6f3ef197-5a10-4a81-be3c-84785f5d3115 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:52.370680 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6f3ef197-5a10-4a81-be3c-84785f5d3115 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:52.371931 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6f3ef197-5a10-4a81-be3c-84785f5d3115 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:52.372371 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6f3ef197-5a10-4a81-be3c-84785f5d3115 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:52.389057 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-6f3ef197-5a10-4a81-be3c-84785f5d3115 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Getting quotas for project add9aa988a0848d185d4f06039cfd00e. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:02:52.393067 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-6f3ef197-5a10-4a81-be3c-84785f5d3115 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Getting quotas for user a112ff54558147cf8739322b085fe1ab and project add9aa988a0848d185d4f06039cfd00e. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:02:52.454903 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-6f3ef197-5a10-4a81-be3c-84785f5d3115 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Going to run 1 instances... {{(pid=127772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:02:52.457352 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-6f3ef197-5a10-4a81-be3c-84785f5d3115 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d1a77d6a-e6ac-4802-b557-eaaab585596e',volume_size=None,volume_type=None)] {{(pid=127772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:02:52.882892 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-6f3ef197-5a10-4a81-be3c-84785f5d3115 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.073385 Sep 09 13:02:52.882892 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 376/756] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 13:02:51 2022] POST /compute/v2.1/servers => generated 404 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:02:52.895110 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-55ba0a61-2ce9-42f0-81bb-947092030719 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:52.903162 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-55ba0a61-2ce9-42f0-81bb-947092030719 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:52.967634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-55ba0a61-2ce9-42f0-81bb-947092030719 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:52.975052 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-55ba0a61-2ce9-42f0-81bb-947092030719 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1089 microversion: 2.1 time: 0.085326 Sep 09 13:02:52.976277 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 381/757] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:52 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1089 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:53.336963 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ec1d8d4d-8201-4e75-b849-99acf3eedcd2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:53.337461 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-ec1d8d4d-8201-4e75-b849-99acf3eedcd2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:53.344590 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ec1d8d4d-8201-4e75-b849-99acf3eedcd2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:53.345072 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ec1d8d4d-8201-4e75-b849-99acf3eedcd2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:53.345505 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ec1d8d4d-8201-4e75-b849-99acf3eedcd2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:53.346201 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ec1d8d4d-8201-4e75-b849-99acf3eedcd2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:53.346694 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ec1d8d4d-8201-4e75-b849-99acf3eedcd2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:53.347118 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ec1d8d4d-8201-4e75-b849-99acf3eedcd2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:53.360848 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-ec1d8d4d-8201-4e75-b849-99acf3eedcd2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] HTTP exception thrown: Instance 7f59545d-0b40-4f82-94e2-789c728a6bed could not be found. Sep 09 13:02:53.364816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ec1d8d4d-8201-4e75-b849-99acf3eedcd2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Request method failure captured: Sep 09 13:02:53.364816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: DELETE /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed HTTP/1.1 Sep 09 13:02:53.364816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 13:02:53.364816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 13:02:53.364816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 13:02:53.364816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 13:02:53.364816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 13:02:53.364816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 13:02:53.364816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 13:02:53.364816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 13:02:53.364816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGzgEaKb6PZCqo9yxUSEJiFD1xb1LGODlWVgID9cA22eqBLNomTmu2q0yMgjccpW69nnUAUWKXMpFaG8X-sF87AhuIdLNOF9PvF4tjoZWf7SNwd1H5TWSvp_IUIt9lOp_NKX-JRPFLgnDrNAvr9jG5GRaXTb0sVN8rNo6hRRXay_HW10 Sep 09 13:02:53.364816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 13:02:53.364816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 13:02:53.364816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 13:02:53.364816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 13:02:53.364816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 13:02:53.364816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 13:02:53.364816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:02:53.364816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:53.364816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 13:02:53.364816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 13:02:53.366511 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ceed6a1f0f4542cbafa4b2a46b16d5fb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}] Sep 09 13:02:53.366511 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:53.366511 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:02:53.366511 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:53.366511 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:02:53.366511 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 13:02:53.366511 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 13:02:53.366511 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: 63a2902f465f4fd1aed80060c2669259 Sep 09 13:02:53.366511 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:02:53.366511 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: > Sep 09 13:02:53.366511 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Instance 7f59545d-0b40-4f82-94e2-789c728a6bed could not be found. Sep 09 13:02:53.366511 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'id': '7f59545d-0b40-4f82-94e2-789c728a6bed'} Sep 09 13:02:53.367664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:02:53.367664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:53.367664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:02:53.367664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:02:53.367664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:02:53.367664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:02:53.367664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:02:53.367664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:02:53.367664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:02:53.367664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:02:53.367664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f59545d-0b40-4f82-94e2-789c728a6bed could not be found. Sep 09 13:02:53.367664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:02:53.367664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:53.367664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:02:53.367664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:53.367664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:53.367664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:53.367664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:02:53.367664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:02:53.367664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:02:53.369225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:02:53.369225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 13:02:53.369225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 13:02:53.369225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 13:02:53.369225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 13:02:53.369225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:02:53.369225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:02:53.369225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:02:53.369225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:02:53.369225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f59545d-0b40-4f82-94e2-789c728a6bed could not be found. Sep 09 13:02:53.369225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:02:53.369225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:53.369225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:02:53.369225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:53.369225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:53.369225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:53.369225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:02:53.369225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:02:53.369225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f59545d-0b40-4f82-94e2-789c728a6bed could not be found. Sep 09 13:02:53.369225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:02:53.370691 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ec1d8d4d-8201-4e75-b849-99acf3eedcd2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Returning 404 to user: Instance 7f59545d-0b40-4f82-94e2-789c728a6bed could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:02:53.370691 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-ec1d8d4d-8201-4e75-b849-99acf3eedcd2 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 404 len: 111 microversion: 2.1 time: 0.031529 Sep 09 13:02:53.370691 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 377/758] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:02:53 2022] DELETE /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:02:53.373471 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a80857df-61b6-4cf8-850f-478bb0c71ea0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:53.373950 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-a80857df-61b6-4cf8-850f-478bb0c71ea0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] [instance: 7f59545d-0b40-4f82-94e2-789c728a6bed] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:53.381639 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a80857df-61b6-4cf8-850f-478bb0c71ea0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:53.382469 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a80857df-61b6-4cf8-850f-478bb0c71ea0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:53.383213 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a80857df-61b6-4cf8-850f-478bb0c71ea0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:53.384307 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a80857df-61b6-4cf8-850f-478bb0c71ea0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:53.384771 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a80857df-61b6-4cf8-850f-478bb0c71ea0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:53.385203 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a80857df-61b6-4cf8-850f-478bb0c71ea0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:53.400405 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-a80857df-61b6-4cf8-850f-478bb0c71ea0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] HTTP exception thrown: Instance 7f59545d-0b40-4f82-94e2-789c728a6bed could not be found. Sep 09 13:02:53.402044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a80857df-61b6-4cf8-850f-478bb0c71ea0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Request method failure captured: Sep 09 13:02:53.402044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed HTTP/1.1 Sep 09 13:02:53.402044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:02:53.402044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:02:53.402044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:02:53.402044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:02:53.402044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:02:53.402044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:02:53.402044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:02:53.402044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:02:53.402044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzgEaKb6PZCqo9yxUSEJiFD1xb1LGODlWVgID9cA22eqBLNomTmu2q0yMgjccpW69nnUAUWKXMpFaG8X-sF87AhuIdLNOF9PvF4tjoZWf7SNwd1H5TWSvp_IUIt9lOp_NKX-JRPFLgnDrNAvr9jG5GRaXTb0sVN8rNo6hRRXay_HW10 Sep 09 13:02:53.402044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:02:53.402044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:02:53.402044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:02:53.402044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:02:53.402044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:02:53.402044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:02:53.402044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:02:53.402044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:53.402044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:02:53.402044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:02:53.404220 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ceed6a1f0f4542cbafa4b2a46b16d5fb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ceed6a1f0f4542cbafa4b2a46b16d5fb"}]}] Sep 09 13:02:53.404220 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:53.404220 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: ceed6a1f0f4542cbafa4b2a46b16d5fb Sep 09 13:02:53.404220 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1099012077 Sep 09 13:02:53.404220 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:02:53.404220 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:02:53.404220 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:02:53.404220 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 63a2902f465f4fd1aed80060c2669259 Sep 09 13:02:53.404220 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-AttachVolumeNegativeTest-1099012077-project Sep 09 13:02:53.404220 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:02:53.404220 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance 7f59545d-0b40-4f82-94e2-789c728a6bed could not be found. Sep 09 13:02:53.404220 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': '7f59545d-0b40-4f82-94e2-789c728a6bed'} Sep 09 13:02:53.405264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:02:53.405264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:53.405264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:02:53.405264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:02:53.405264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:02:53.405264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:02:53.405264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:02:53.405264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:02:53.405264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:02:53.405264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:02:53.405264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f59545d-0b40-4f82-94e2-789c728a6bed could not be found. Sep 09 13:02:53.405264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:53.405264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:53.405264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:53.405264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:53.405264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:53.405264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:53.405264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:02:53.405264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:02:53.405264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:02:53.406940 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:02:53.406940 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:02:53.406940 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:02:53.406940 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:02:53.406940 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:02:53.406940 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:02:53.406940 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:02:53.406940 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f59545d-0b40-4f82-94e2-789c728a6bed could not be found. Sep 09 13:02:53.406940 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:53.406940 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:02:53.406940 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:53.406940 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:02:53.406940 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:02:53.406940 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:02:53.406940 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:02:53.406940 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:02:53.406940 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f59545d-0b40-4f82-94e2-789c728a6bed could not be found. Sep 09 13:02:53.406940 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:02:53.408295 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a80857df-61b6-4cf8-850f-478bb0c71ea0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] Returning 404 to user: Instance 7f59545d-0b40-4f82-94e2-789c728a6bed could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:02:53.408295 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-a80857df-61b6-4cf8-850f-478bb0c71ea0 tempest-AttachVolumeNegativeTest-1099012077 tempest-AttachVolumeNegativeTest-1099012077-project] 10.222.0.46 "GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed" status: 404 len: 111 microversion: 2.1 time: 0.037126 Sep 09 13:02:53.408295 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 382/759] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:53 2022] GET /compute/v2.1/servers/7f59545d-0b40-4f82-94e2-789c728a6bed => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:02:53.997981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-762e3f39-5fdc-43ac-9466-69d0545e5740 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:53.998614 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-762e3f39-5fdc-43ac-9466-69d0545e5740 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:54.005052 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-762e3f39-5fdc-43ac-9466-69d0545e5740 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:54.005829 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-762e3f39-5fdc-43ac-9466-69d0545e5740 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:54.006837 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-762e3f39-5fdc-43ac-9466-69d0545e5740 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:54.007049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-762e3f39-5fdc-43ac-9466-69d0545e5740 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:54.007418 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-762e3f39-5fdc-43ac-9466-69d0545e5740 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:54.008020 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-762e3f39-5fdc-43ac-9466-69d0545e5740 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:54.103867 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-762e3f39-5fdc-43ac-9466-69d0545e5740 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:54.112428 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-762e3f39-5fdc-43ac-9466-69d0545e5740 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1139 microversion: 2.1 time: 0.118336 Sep 09 13:02:54.113081 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 378/760] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:53 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1139 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:55.135556 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-6e5d0aef-7e2c-4d2a-bf08-d753e48a4cad tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:55.138266 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-6e5d0aef-7e2c-4d2a-bf08-d753e48a4cad tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:55.145259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6e5d0aef-7e2c-4d2a-bf08-d753e48a4cad tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:55.146057 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6e5d0aef-7e2c-4d2a-bf08-d753e48a4cad tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:55.146766 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6e5d0aef-7e2c-4d2a-bf08-d753e48a4cad tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:55.147702 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6e5d0aef-7e2c-4d2a-bf08-d753e48a4cad tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:55.148255 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6e5d0aef-7e2c-4d2a-bf08-d753e48a4cad tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:55.148893 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6e5d0aef-7e2c-4d2a-bf08-d753e48a4cad tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:55.255207 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-6e5d0aef-7e2c-4d2a-bf08-d753e48a4cad tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:55.266028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-6e5d0aef-7e2c-4d2a-bf08-d753e48a4cad tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1195 microversion: 2.1 time: 0.133197 Sep 09 13:02:55.266866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 383/761] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:55 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1195 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:56.305664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-def9d7b7-54c6-4342-8961-5d79d55ef221 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:56.305664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-def9d7b7-54c6-4342-8961-5d79d55ef221 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:56.310186 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-def9d7b7-54c6-4342-8961-5d79d55ef221 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:56.310729 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-def9d7b7-54c6-4342-8961-5d79d55ef221 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:56.311198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-def9d7b7-54c6-4342-8961-5d79d55ef221 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:56.311882 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-def9d7b7-54c6-4342-8961-5d79d55ef221 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:56.312346 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-def9d7b7-54c6-4342-8961-5d79d55ef221 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:56.312808 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-def9d7b7-54c6-4342-8961-5d79d55ef221 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:56.392753 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-def9d7b7-54c6-4342-8961-5d79d55ef221 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:56.401821 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-def9d7b7-54c6-4342-8961-5d79d55ef221 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1205 microversion: 2.1 time: 0.103097 Sep 09 13:02:56.409392 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 379/762] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:56 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1205 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:02:57.436690 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-f5d5fb6b-9aee-4b18-b5d0-feb900312ed1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:57.437487 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-f5d5fb6b-9aee-4b18-b5d0-feb900312ed1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:57.440451 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:02:57.447571 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f5d5fb6b-9aee-4b18-b5d0-feb900312ed1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:57.448448 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f5d5fb6b-9aee-4b18-b5d0-feb900312ed1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:57.449672 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f5d5fb6b-9aee-4b18-b5d0-feb900312ed1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:57.451129 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f5d5fb6b-9aee-4b18-b5d0-feb900312ed1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:57.452221 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f5d5fb6b-9aee-4b18-b5d0-feb900312ed1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:57.452801 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f5d5fb6b-9aee-4b18-b5d0-feb900312ed1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:57.754914 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-f5d5fb6b-9aee-4b18-b5d0-feb900312ed1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:57.765888 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-f5d5fb6b-9aee-4b18-b5d0-feb900312ed1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1259 microversion: 2.1 time: 0.338865 Sep 09 13:02:57.766714 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 384/763] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:57 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1259 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:02:58.096693 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-c6445249-e8d7-4698-8cb2-107ec5fecc5b req-0d74b5c9-5a96-416c-b414-ad3bb4c38acd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10884cc0-9f01-425e-8d5f-9e0727a68b5e", "tag": "b5735773-f9c8-4cb1-80c8-146eef0519fe"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:02:58.108434 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-c6445249-e8d7-4698-8cb2-107ec5fecc5b req-0d74b5c9-5a96-416c-b414-ad3bb4c38acd service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:58.109022 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-c6445249-e8d7-4698-8cb2-107ec5fecc5b req-0d74b5c9-5a96-416c-b414-ad3bb4c38acd service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:58.109456 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-c6445249-e8d7-4698-8cb2-107ec5fecc5b req-0d74b5c9-5a96-416c-b414-ad3bb4c38acd service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:58.122034 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-c6445249-e8d7-4698-8cb2-107ec5fecc5b req-0d74b5c9-5a96-416c-b414-ad3bb4c38acd service nova] Creating event network-changed:b5735773-f9c8-4cb1-80c8-146eef0519fe for instance 10884cc0-9f01-425e-8d5f-9e0727a68b5e on hv-cinder-81322 Sep 09 13:02:58.128733 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-c6445249-e8d7-4698-8cb2-107ec5fecc5b req-0d74b5c9-5a96-416c-b414-ad3bb4c38acd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036562 Sep 09 13:02:58.128733 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 380/764] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:02:58.789731 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ed8f40b3-a0dd-4cd9-9fac-cb4f3d23694e tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:02:58.791111 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ed8f40b3-a0dd-4cd9-9fac-cb4f3d23694e tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:02:58.804640 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ed8f40b3-a0dd-4cd9-9fac-cb4f3d23694e tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:58.805327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ed8f40b3-a0dd-4cd9-9fac-cb4f3d23694e tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:58.807539 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ed8f40b3-a0dd-4cd9-9fac-cb4f3d23694e tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:58.807539 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ed8f40b3-a0dd-4cd9-9fac-cb4f3d23694e tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:02:58.807539 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ed8f40b3-a0dd-4cd9-9fac-cb4f3d23694e tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:02:58.808139 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ed8f40b3-a0dd-4cd9-9fac-cb4f3d23694e tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:02:58.988651 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ed8f40b3-a0dd-4cd9-9fac-cb4f3d23694e tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:02:58.997995 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ed8f40b3-a0dd-4cd9-9fac-cb4f3d23694e tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1259 microversion: 2.1 time: 0.212521 Sep 09 13:02:58.998756 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 385/765] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:02:58 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1259 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:00.021686 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-df64e9cd-be7c-4d5d-8d3c-5f8cf9b0c822 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:00.022305 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-df64e9cd-be7c-4d5d-8d3c-5f8cf9b0c822 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:00.029567 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-df64e9cd-be7c-4d5d-8d3c-5f8cf9b0c822 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:00.030075 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-df64e9cd-be7c-4d5d-8d3c-5f8cf9b0c822 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:00.031543 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-df64e9cd-be7c-4d5d-8d3c-5f8cf9b0c822 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:00.031543 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-df64e9cd-be7c-4d5d-8d3c-5f8cf9b0c822 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:00.031721 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-df64e9cd-be7c-4d5d-8d3c-5f8cf9b0c822 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:00.032140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-df64e9cd-be7c-4d5d-8d3c-5f8cf9b0c822 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:00.080868 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-517ebb1e-dc8a-468e-a3a4-97f2cd1714d7 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Action: 'create', calling method: .version_select at 0x7f3182e96ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1774615300"}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:03:00.173725 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-df64e9cd-be7c-4d5d-8d3c-5f8cf9b0c822 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:00.187215 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-df64e9cd-be7c-4d5d-8d3c-5f8cf9b0c822 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1259 microversion: 2.1 time: 0.169230 Sep 09 13:03:00.192858 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 386/766] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:00 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:00.728188 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-517ebb1e-dc8a-468e-a3a4-97f2cd1714d7 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.770294 Sep 09 13:03:00.728864 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 381/767] 10.222.0.46 () {60 vars in 1155 bytes} [Fri Sep 9 13:02:59 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 772 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 13:03:00.741489 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-b1a5ee53-963e-4d6d-afa3-9cad1a6edae0 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Calling method '.version_select at 0x7f3182f3a940>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:00.792953 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-b1a5ee53-963e-4d6d-afa3-9cad1a6edae0 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/2ca25f7a-ea72-4537-a30c-744c3035b221" status: 200 len: 345 microversion: 2.1 time: 0.054944 Sep 09 13:03:00.800059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 387/768] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 13:03:00 2022] GET /compute/v2.1/os-volumes/2ca25f7a-ea72-4537-a30c-744c3035b221 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:03:01.215259 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-0428ae50-d53c-4e2f-8133-36d32fb8ade8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:01.216184 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-0428ae50-d53c-4e2f-8133-36d32fb8ade8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:01.227056 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0428ae50-d53c-4e2f-8133-36d32fb8ade8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:01.227056 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0428ae50-d53c-4e2f-8133-36d32fb8ade8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:01.227056 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0428ae50-d53c-4e2f-8133-36d32fb8ade8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:01.227056 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0428ae50-d53c-4e2f-8133-36d32fb8ade8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:01.227464 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0428ae50-d53c-4e2f-8133-36d32fb8ade8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:01.227464 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0428ae50-d53c-4e2f-8133-36d32fb8ade8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:01.366966 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-0428ae50-d53c-4e2f-8133-36d32fb8ade8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:01.375830 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-0428ae50-d53c-4e2f-8133-36d32fb8ade8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1259 microversion: 2.1 time: 0.165213 Sep 09 13:03:01.376403 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 382/769] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:01 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:01.807826 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-9e9e4f9a-0d78-4589-bf7e-d500b805988f tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Calling method '.version_select at 0x7f3182f2d940>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:01.855820 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-9e9e4f9a-0d78-4589-bf7e-d500b805988f tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/2ca25f7a-ea72-4537-a30c-744c3035b221" status: 200 len: 346 microversion: 2.1 time: 0.051646 Sep 09 13:03:01.856383 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 388/770] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 13:03:01 2022] GET /compute/v2.1/os-volumes/2ca25f7a-ea72-4537-a30c-744c3035b221 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:03:01.869245 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-0d3aec1f-eb6c-4b51-9fbc-c4e8dfbea8ec tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Action: 'create', calling method: .version_select at 0x7f3182e96f70>, body: {"snapshot": {"volume_id": "2ca25f7a-ea72-4537-a30c-744c3035b221", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2101687953"}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:03:02.280647 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-0d3aec1f-eb6c-4b51-9fbc-c4e8dfbea8ec tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.415050 Sep 09 13:03:02.281235 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 383/771] 10.222.0.46 () {60 vars in 1162 bytes} [Fri Sep 9 13:03:01 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:03:02.292376 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-7af3cbb0-ad30-4a95-ae3e-8b4c9d29e09f tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Calling method '.version_select at 0x7f3182f67ee0>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:02.323331 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-7af3cbb0-ad30-4a95-ae3e-8b4c9d29e09f tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/fe7fe158-59ac-4775-b7d7-aaf37268b23d" status: 200 len: 287 microversion: 2.1 time: 0.034941 Sep 09 13:03:02.323963 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 389/772] 10.222.0.46 () {58 vars in 1251 bytes} [Fri Sep 9 13:03:02 2022] GET /compute/v2.1/os-snapshots/fe7fe158-59ac-4775-b7d7-aaf37268b23d => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:03:02.335533 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-5c1ddf9e-fe3b-4402-a257-c7abe2a4f3de tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Calling method '.version_select at 0x7f3182e773a0>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:02.368459 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-5c1ddf9e-fe3b-4402-a257-c7abe2a4f3de tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.036945 Sep 09 13:03:02.373636 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 384/773] 10.222.0.46 () {58 vars in 1140 bytes} [Fri Sep 9 13:03:02 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:03:02.381353 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-66925bc4-fcb2-4562-b79d-f79b347df19a tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Calling method '.version_select at 0x7f3182f3aee0>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:02.396806 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=2 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:03:02.400520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-3a9b78d2-9ede-46e8-a5db-de5074b54ab8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:02.401127 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-3a9b78d2-9ede-46e8-a5db-de5074b54ab8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:02.403106 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=6 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:03:02.407876 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3a9b78d2-9ede-46e8-a5db-de5074b54ab8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:02.408385 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3a9b78d2-9ede-46e8-a5db-de5074b54ab8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:02.408796 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3a9b78d2-9ede-46e8-a5db-de5074b54ab8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:02.409529 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3a9b78d2-9ede-46e8-a5db-de5074b54ab8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:02.410007 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3a9b78d2-9ede-46e8-a5db-de5074b54ab8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:02.410413 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3a9b78d2-9ede-46e8-a5db-de5074b54ab8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:02.411753 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-66925bc4-fcb2-4562-b79d-f79b347df19a tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/fe7fe158-59ac-4775-b7d7-aaf37268b23d" status: 200 len: 287 microversion: 2.1 time: 0.034097 Sep 09 13:03:02.412434 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 390/774] 10.222.0.46 () {58 vars in 1251 bytes} [Fri Sep 9 13:03:02 2022] GET /compute/v2.1/os-snapshots/fe7fe158-59ac-4775-b7d7-aaf37268b23d => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:03:02.543482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-3a9b78d2-9ede-46e8-a5db-de5074b54ab8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:02.551088 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-3a9b78d2-9ede-46e8-a5db-de5074b54ab8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1259 microversion: 2.1 time: 0.155434 Sep 09 13:03:02.551647 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 385/775] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:02 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:03.421873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=2 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:03:03.426092 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0ff16717-7b44-4594-832d-b7deded5d74b tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Calling method '.version_select at 0x7f3182f894c0>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:03.457636 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0ff16717-7b44-4594-832d-b7deded5d74b tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/fe7fe158-59ac-4775-b7d7-aaf37268b23d" status: 200 len: 287 microversion: 2.1 time: 0.036821 Sep 09 13:03:03.458222 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 391/776] 10.222.0.46 () {58 vars in 1251 bytes} [Fri Sep 9 13:03:03 2022] GET /compute/v2.1/os-snapshots/fe7fe158-59ac-4775-b7d7-aaf37268b23d => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:03:03.581651 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-8853fc6e-1e1c-4265-aedc-f7c17cbe3e57 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:03.582243 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-8853fc6e-1e1c-4265-aedc-f7c17cbe3e57 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:03.588709 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8853fc6e-1e1c-4265-aedc-f7c17cbe3e57 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:03.589189 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8853fc6e-1e1c-4265-aedc-f7c17cbe3e57 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:03.589628 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8853fc6e-1e1c-4265-aedc-f7c17cbe3e57 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:03.590304 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8853fc6e-1e1c-4265-aedc-f7c17cbe3e57 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:03.590775 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8853fc6e-1e1c-4265-aedc-f7c17cbe3e57 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:03.591194 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8853fc6e-1e1c-4265-aedc-f7c17cbe3e57 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:03.727243 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-8853fc6e-1e1c-4265-aedc-f7c17cbe3e57 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:03.735800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-8853fc6e-1e1c-4265-aedc-f7c17cbe3e57 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1259 microversion: 2.1 time: 0.158244 Sep 09 13:03:03.736373 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 386/777] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:03 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:04.470898 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-c2aa4016-effd-407e-a0d1-7e6e7f624a60 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Calling method '.version_select at 0x7f3182f65550>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:04.503122 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-c2aa4016-effd-407e-a0d1-7e6e7f624a60 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/fe7fe158-59ac-4775-b7d7-aaf37268b23d" status: 200 len: 287 microversion: 2.1 time: 0.036501 Sep 09 13:03:04.503689 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 392/778] 10.222.0.46 () {58 vars in 1251 bytes} [Fri Sep 9 13:03:04 2022] GET /compute/v2.1/os-snapshots/fe7fe158-59ac-4775-b7d7-aaf37268b23d => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:03:04.758654 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-db25e466-9f6f-466e-b4b3-5c6b3fada446 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:04.759190 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-db25e466-9f6f-466e-b4b3-5c6b3fada446 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:04.765779 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-db25e466-9f6f-466e-b4b3-5c6b3fada446 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:04.766269 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-db25e466-9f6f-466e-b4b3-5c6b3fada446 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:04.766746 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-db25e466-9f6f-466e-b4b3-5c6b3fada446 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:04.767451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-db25e466-9f6f-466e-b4b3-5c6b3fada446 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:04.768027 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-db25e466-9f6f-466e-b4b3-5c6b3fada446 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:04.768462 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-db25e466-9f6f-466e-b4b3-5c6b3fada446 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:04.906630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-db25e466-9f6f-466e-b4b3-5c6b3fada446 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:04.914408 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-db25e466-9f6f-466e-b4b3-5c6b3fada446 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1259 microversion: 2.1 time: 0.159888 Sep 09 13:03:04.915027 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 387/779] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:04 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:05.516654 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-be43fb99-b2df-4011-a7aa-901f5060a947 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Calling method '.version_select at 0x7f3182f2d040>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:05.554416 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-be43fb99-b2df-4011-a7aa-901f5060a947 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/fe7fe158-59ac-4775-b7d7-aaf37268b23d" status: 200 len: 288 microversion: 2.1 time: 0.041895 Sep 09 13:03:05.561764 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 393/780] 10.222.0.46 () {58 vars in 1251 bytes} [Fri Sep 9 13:03:05 2022] GET /compute/v2.1/os-snapshots/fe7fe158-59ac-4775-b7d7-aaf37268b23d => generated 288 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:03:05.567850 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a22d4d61-9099-4a4b-99c2-9a91cff68402 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Calling method '.version_select at 0x7f3182e96ca0>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:05.679829 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a22d4d61-9099-4a4b-99c2-9a91cff68402 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/fe7fe158-59ac-4775-b7d7-aaf37268b23d" status: 202 len: 0 microversion: 2.1 time: 0.116408 Sep 09 13:03:05.680402 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 388/781] 10.222.0.46 () {58 vars in 1254 bytes} [Fri Sep 9 13:03:05 2022] DELETE /compute/v2.1/os-snapshots/fe7fe158-59ac-4775-b7d7-aaf37268b23d => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:03:05.689388 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-5feb9b74-35bc-4ebd-aa62-8fac7e56101e tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Calling method '.version_select at 0x7f3182f2d820>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:05.720839 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-5feb9b74-35bc-4ebd-aa62-8fac7e56101e tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/fe7fe158-59ac-4775-b7d7-aaf37268b23d" status: 200 len: 287 microversion: 2.1 time: 0.035630 Sep 09 13:03:05.721557 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 394/782] 10.222.0.46 () {58 vars in 1251 bytes} [Fri Sep 9 13:03:05 2022] GET /compute/v2.1/os-snapshots/fe7fe158-59ac-4775-b7d7-aaf37268b23d => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:03:05.938241 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-59b31a47-24eb-43cd-a129-2eac28f0c101 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:05.938840 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-59b31a47-24eb-43cd-a129-2eac28f0c101 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:05.944860 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-59b31a47-24eb-43cd-a129-2eac28f0c101 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:05.945403 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-59b31a47-24eb-43cd-a129-2eac28f0c101 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:05.945844 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-59b31a47-24eb-43cd-a129-2eac28f0c101 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:05.946562 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-59b31a47-24eb-43cd-a129-2eac28f0c101 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:05.947022 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-59b31a47-24eb-43cd-a129-2eac28f0c101 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:05.947449 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-59b31a47-24eb-43cd-a129-2eac28f0c101 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:06.081709 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-59b31a47-24eb-43cd-a129-2eac28f0c101 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:06.090064 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-59b31a47-24eb-43cd-a129-2eac28f0c101 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1259 microversion: 2.1 time: 0.155672 Sep 09 13:03:06.090924 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 389/783] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:05 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:06.588066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-76c0096f-e8e1-4e98-8816-75f5df95a7a5 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:06.590365 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-76c0096f-e8e1-4e98-8816-75f5df95a7a5 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:06.596868 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-76c0096f-e8e1-4e98-8816-75f5df95a7a5 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:06.597349 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-76c0096f-e8e1-4e98-8816-75f5df95a7a5 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:06.597786 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-76c0096f-e8e1-4e98-8816-75f5df95a7a5 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:06.598474 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-76c0096f-e8e1-4e98-8816-75f5df95a7a5 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:06.598946 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-76c0096f-e8e1-4e98-8816-75f5df95a7a5 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:06.599369 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-76c0096f-e8e1-4e98-8816-75f5df95a7a5 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:06.628641 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-76c0096f-e8e1-4e98-8816-75f5df95a7a5 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044982 Sep 09 13:03:06.629173 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 395/784] 10.222.0.46 () {60 vars in 1343 bytes} [Fri Sep 9 13:03:06 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:06.693013 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-2ee4fe04-d29b-4b1d-92fc-e6c30930a99c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:06.693512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-2ee4fe04-d29b-4b1d-92fc-e6c30930a99c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:06.700021 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2ee4fe04-d29b-4b1d-92fc-e6c30930a99c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:06.700512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2ee4fe04-d29b-4b1d-92fc-e6c30930a99c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:06.700949 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2ee4fe04-d29b-4b1d-92fc-e6c30930a99c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:06.702401 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2ee4fe04-d29b-4b1d-92fc-e6c30930a99c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:06.702401 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2ee4fe04-d29b-4b1d-92fc-e6c30930a99c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:06.702663 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2ee4fe04-d29b-4b1d-92fc-e6c30930a99c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:06.731790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-2ee4fe04-d29b-4b1d-92fc-e6c30930a99c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Going to try to terminate instance {{(pid=127772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:03:06.733766 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-7e086f4a-863a-4337-901b-377e94b34183 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Calling method '.version_select at 0x7f3182fa40d0>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:06.761164 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-7e086f4a-863a-4337-901b-377e94b34183 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] HTTP exception thrown: Snapshot fe7fe158-59ac-4775-b7d7-aaf37268b23d could not be found. Sep 09 13:03:06.763746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-7e086f4a-863a-4337-901b-377e94b34183 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Request method failure captured: Sep 09 13:03:06.763746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: GET /compute/v2.1/os-snapshots/fe7fe158-59ac-4775-b7d7-aaf37268b23d HTTP/1.1 Sep 09 13:03:06.763746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:03:06.763746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:03:06.763746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:03:06.763746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:03:06.763746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:03:06.763746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:03:06.763746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:03:06.763746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:03:06.763746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzmDM7zWdNy8w6oTTOZiiI4p-bu2sganP9L0tY4FMuAREaA50cfQ6BNW84Y3iW98oWSkHDCk0Ry0JIo9vnf704SO-pDN2uyXxgyL1kSHslD8E2YHMs0HsuFyI2Q6d2XvkgnMWcmrQcgnkCT5iGkvQzwSTX7u2J-B4GJWDrKDgib_s8g Sep 09 13:03:06.763746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:03:06.763746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:03:06.763746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:03:06.763746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:03:06.763746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:03:06.763746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:03:06.763746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: 4d8ac804454c4a268df09701c1c55ac2 Sep 09 13:03:06.763746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-582050675 Sep 09 13:03:06.763746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:03:06.763746 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:03:06.765293 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4d8ac804454c4a268df09701c1c55ac2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4d8ac804454c4a268df09701c1c55ac2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4d8ac804454c4a268df09701c1c55ac2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4d8ac804454c4a268df09701c1c55ac2"}]}] Sep 09 13:03:06.765293 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-VolumesSnapshotsTestJSON-582050675 Sep 09 13:03:06.765293 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: 4d8ac804454c4a268df09701c1c55ac2 Sep 09 13:03:06.765293 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-582050675 Sep 09 13:03:06.765293 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-VolumesSnapshotsTestJSON-582050675-project Sep 09 13:03:06.765293 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:03:06.765293 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:03:06.765293 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 8263eb1f157548519990dba4c2300e91 Sep 09 13:03:06.765293 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-VolumesSnapshotsTestJSON-582050675-project Sep 09 13:03:06.765293 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: Sep 09 13:03:06.765293 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Snapshot fe7fe158-59ac-4775-b7d7-aaf37268b23d could not be found. Sep 09 13:03:06.765293 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': 'fe7fe158-59ac-4775-b7d7-aaf37268b23d'} Sep 09 13:03:06.765293 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:03:06.766240 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:06.766240 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 13:03:06.766240 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 13:03:06.766240 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 13:03:06.766240 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 13:03:06.766240 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 13:03:06.766240 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 13:03:06.766240 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 13:03:06.766240 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 13:03:06.766240 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 13:03:06.766240 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 13:03:06.766240 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:03:06.766240 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:03:06.766240 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:03:06.766240 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:03:06.766240 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fe7fe158-59ac-4775-b7d7-aaf37268b23d could not be found. (HTTP 404) (Request-ID: req-a4ddfdc9-0a93-45e0-ac83-d84c7112554c) Sep 09 13:03:06.766240 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:06.766240 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:06.767373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:06.767373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:06.767373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 09 13:03:06.767373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 09 13:03:06.767373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 13:03:06.767373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 13:03:06.767373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 09 13:03:06.767373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 09 13:03:06.767373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 13:03:06.767373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 13:03:06.767373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 13:03:06.767373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 13:03:06.767373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 13:03:06.767373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 13:03:06.767373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 13:03:06.767373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 13:03:06.767373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 13:03:06.767373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 13:03:06.767373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 13:03:06.768589 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 13:03:06.768589 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:03:06.768589 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:03:06.768589 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:03:06.768589 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:03:06.768589 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fe7fe158-59ac-4775-b7d7-aaf37268b23d could not be found. Sep 09 13:03:06.768589 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:06.768589 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:06.768589 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:06.768589 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:06.768589 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:03:06.768589 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:03:06.768589 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:03:06.768589 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:03:06.768589 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 13:03:06.768589 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 13:03:06.768589 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:03:06.768589 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:03:06.768589 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 09 13:03:06.768589 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:03:06.770059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fe7fe158-59ac-4775-b7d7-aaf37268b23d could not be found. Sep 09 13:03:06.770059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:06.770059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:06.770059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:06.770059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:06.770059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:03:06.770059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:03:06.770059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:03:06.770059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:03:06.770059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fe7fe158-59ac-4775-b7d7-aaf37268b23d could not be found. Sep 09 13:03:06.770059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:06.770059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-7e086f4a-863a-4337-901b-377e94b34183 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Returning 404 to user: Snapshot fe7fe158-59ac-4775-b7d7-aaf37268b23d could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:03:06.770059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-7e086f4a-863a-4337-901b-377e94b34183 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/fe7fe158-59ac-4775-b7d7-aaf37268b23d" status: 404 len: 111 microversion: 2.1 time: 0.036023 Sep 09 13:03:06.770059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 396/785] 10.222.0.46 () {58 vars in 1251 bytes} [Fri Sep 9 13:03:06 2022] GET /compute/v2.1/os-snapshots/fe7fe158-59ac-4775-b7d7-aaf37268b23d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 13:03:06.771284 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:03:06.774059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-79be2920-221d-4d95-9e4b-dfa0799dd536 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Calling method '.version_select at 0x7f3183196280>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:06.954181 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-79be2920-221d-4d95-9e4b-dfa0799dd536 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/2ca25f7a-ea72-4537-a30c-744c3035b221" status: 202 len: 0 microversion: 2.1 time: 0.183856 Sep 09 13:03:06.954785 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 397/786] 10.222.0.46 () {58 vars in 1248 bytes} [Fri Sep 9 13:03:06 2022] DELETE /compute/v2.1/os-volumes/2ca25f7a-ea72-4537-a30c-744c3035b221 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:03:06.963499 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d623e7fa-a104-4072-a1ce-e0723b564b6e tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Calling method '.version_select at 0x7f3183333160>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:06.977578 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-2ee4fe04-d29b-4b1d-92fc-e6c30930a99c tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "DELETE /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 204 len: 0 microversion: 2.20 time: 0.283185 Sep 09 13:03:06.977578 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 390/787] 10.222.0.46 () {60 vars in 1280 bytes} [Fri Sep 9 13:03:06 2022] DELETE /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 09 13:03:06.983087 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-4d71eab9-2d05-480f-95bf-911f3fd54ed4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:06.983778 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-4d71eab9-2d05-480f-95bf-911f3fd54ed4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:06.989859 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d71eab9-2d05-480f-95bf-911f3fd54ed4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:06.990347 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d71eab9-2d05-480f-95bf-911f3fd54ed4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:06.990888 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d71eab9-2d05-480f-95bf-911f3fd54ed4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:06.991628 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d71eab9-2d05-480f-95bf-911f3fd54ed4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:06.992083 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d71eab9-2d05-480f-95bf-911f3fd54ed4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:06.992546 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4d71eab9-2d05-480f-95bf-911f3fd54ed4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:07.013634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d623e7fa-a104-4072-a1ce-e0723b564b6e tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/2ca25f7a-ea72-4537-a30c-744c3035b221" status: 200 len: 345 microversion: 2.1 time: 0.053199 Sep 09 13:03:07.014456 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 398/788] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 13:03:06 2022] GET /compute/v2.1/os-volumes/2ca25f7a-ea72-4537-a30c-744c3035b221 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:03:07.113261 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-52e1d5c4-e9c8-47de-b50d-8cfefe048683 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:07.113980 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-52e1d5c4-e9c8-47de-b50d-8cfefe048683 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:07.120445 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52e1d5c4-e9c8-47de-b50d-8cfefe048683 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:07.120938 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52e1d5c4-e9c8-47de-b50d-8cfefe048683 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:07.121367 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52e1d5c4-e9c8-47de-b50d-8cfefe048683 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:07.122852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52e1d5c4-e9c8-47de-b50d-8cfefe048683 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:07.123312 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52e1d5c4-e9c8-47de-b50d-8cfefe048683 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:07.123729 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52e1d5c4-e9c8-47de-b50d-8cfefe048683 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:07.136894 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-4d71eab9-2d05-480f-95bf-911f3fd54ed4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:07.145788 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-4d71eab9-2d05-480f-95bf-911f3fd54ed4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:07.147264 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-4d71eab9-2d05-480f-95bf-911f3fd54ed4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:07.148421 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-4d71eab9-2d05-480f-95bf-911f3fd54ed4 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1720 microversion: 2.20 time: 0.169655 Sep 09 13:03:07.149171 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 391/789] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:03:06 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:03:07.257695 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-52e1d5c4-e9c8-47de-b50d-8cfefe048683 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:07.266363 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-52e1d5c4-e9c8-47de-b50d-8cfefe048683 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1259 microversion: 2.1 time: 0.157081 Sep 09 13:03:07.266977 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 399/790] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:07 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:03:08.029191 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-afa8bcfe-8c01-4a0a-ac80-1e008161b346 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Calling method '.version_select at 0x7f3182f0a1f0>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:08.058748 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-afa8bcfe-8c01-4a0a-ac80-1e008161b346 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] HTTP exception thrown: Volume 2ca25f7a-ea72-4537-a30c-744c3035b221 could not be found. Sep 09 13:03:08.061040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-afa8bcfe-8c01-4a0a-ac80-1e008161b346 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Request method failure captured: Sep 09 13:03:08.061040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: GET /compute/v2.1/os-volumes/2ca25f7a-ea72-4537-a30c-744c3035b221 HTTP/1.1 Sep 09 13:03:08.061040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 13:03:08.061040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 13:03:08.061040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 13:03:08.061040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 13:03:08.061040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 13:03:08.061040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 13:03:08.061040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 13:03:08.061040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 13:03:08.061040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGzmDM7zWdNy8w6oTTOZiiI4p-bu2sganP9L0tY4FMuAREaA50cfQ6BNW84Y3iW98oWSkHDCk0Ry0JIo9vnf704SO-pDN2uyXxgyL1kSHslD8E2YHMs0HsuFyI2Q6d2XvkgnMWcmrQcgnkCT5iGkvQzwSTX7u2J-B4GJWDrKDgib_s8g Sep 09 13:03:08.061040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 13:03:08.061040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 13:03:08.061040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 13:03:08.061040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 13:03:08.061040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 13:03:08.061040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 13:03:08.061040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: 4d8ac804454c4a268df09701c1c55ac2 Sep 09 13:03:08.061040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-582050675 Sep 09 13:03:08.061040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 13:03:08.061040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 13:03:08.062599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4d8ac804454c4a268df09701c1c55ac2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4d8ac804454c4a268df09701c1c55ac2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4d8ac804454c4a268df09701c1c55ac2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4d8ac804454c4a268df09701c1c55ac2"}]}] Sep 09 13:03:08.062599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-VolumesSnapshotsTestJSON-582050675 Sep 09 13:03:08.062599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: 4d8ac804454c4a268df09701c1c55ac2 Sep 09 13:03:08.062599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-582050675 Sep 09 13:03:08.062599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-VolumesSnapshotsTestJSON-582050675-project Sep 09 13:03:08.062599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 13:03:08.062599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 13:03:08.062599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: 8263eb1f157548519990dba4c2300e91 Sep 09 13:03:08.062599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-VolumesSnapshotsTestJSON-582050675-project Sep 09 13:03:08.062599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: Sep 09 13:03:08.062599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Volume 2ca25f7a-ea72-4537-a30c-744c3035b221 could not be found. Sep 09 13:03:08.062599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'id': '2ca25f7a-ea72-4537-a30c-744c3035b221'} Sep 09 13:03:08.062599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:03:08.063534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:08.063534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 13:03:08.063534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 13:03:08.063534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 13:03:08.063534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 13:03:08.063534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 13:03:08.063534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 13:03:08.063534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 13:03:08.063534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 13:03:08.063534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 13:03:08.063534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 13:03:08.063534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:03:08.063534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:03:08.063534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:03:08.063534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:03:08.063534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ca25f7a-ea72-4537-a30c-744c3035b221 could not be found. (HTTP 404) (Request-ID: req-081c5371-2bb3-4bac-9759-518ca094578e) Sep 09 13:03:08.063534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:08.063534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:08.063534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:08.064763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:08.064763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 13:03:08.064763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 13:03:08.064763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 13:03:08.064763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 13:03:08.064763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 13:03:08.064763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 13:03:08.064763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 13:03:08.064763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 13:03:08.064763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 13:03:08.064763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 13:03:08.064763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 13:03:08.064763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 13:03:08.064763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 13:03:08.064763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 13:03:08.064763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 13:03:08.064763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 13:03:08.064763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 13:03:08.064763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 13:03:08.066262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:03:08.066262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:03:08.066262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:03:08.066262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:03:08.066262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ca25f7a-ea72-4537-a30c-744c3035b221 could not be found. Sep 09 13:03:08.066262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:08.066262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:08.066262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:08.066262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:08.066262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:03:08.066262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:03:08.066262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:03:08.066262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:03:08.066262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 13:03:08.066262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 13:03:08.066262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:03:08.066262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:03:08.066262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 13:03:08.066262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:03:08.067746 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ca25f7a-ea72-4537-a30c-744c3035b221 could not be found. Sep 09 13:03:08.067746 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:08.067746 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:08.067746 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:08.067746 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:08.067746 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:03:08.067746 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:03:08.067746 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:03:08.067746 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:03:08.067746 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ca25f7a-ea72-4537-a30c-744c3035b221 could not be found. Sep 09 13:03:08.067746 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:08.067746 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-afa8bcfe-8c01-4a0a-ac80-1e008161b346 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Returning 404 to user: Volume 2ca25f7a-ea72-4537-a30c-744c3035b221 could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:03:08.067746 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-afa8bcfe-8c01-4a0a-ac80-1e008161b346 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/2ca25f7a-ea72-4537-a30c-744c3035b221" status: 404 len: 109 microversion: 2.1 time: 0.039059 Sep 09 13:03:08.067746 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 392/791] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 13:03:08 2022] GET /compute/v2.1/os-volumes/2ca25f7a-ea72-4537-a30c-744c3035b221 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:03:08.076860 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-80bb7a9f-e4ba-4fd7-9d9c-e64e5387c084 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Calling method '.version_select at 0x7f3183120040>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:08.113085 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-80bb7a9f-e4ba-4fd7-9d9c-e64e5387c084 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] HTTP exception thrown: Volume 2ca25f7a-ea72-4537-a30c-744c3035b221 could not be found. Sep 09 13:03:08.115135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-80bb7a9f-e4ba-4fd7-9d9c-e64e5387c084 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Request method failure captured: Sep 09 13:03:08.115135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: DELETE /compute/v2.1/os-volumes/2ca25f7a-ea72-4537-a30c-744c3035b221 HTTP/1.1 Sep 09 13:03:08.115135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:03:08.115135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:03:08.115135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:03:08.115135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:03:08.115135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:03:08.115135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:03:08.115135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:03:08.115135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:03:08.115135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzmDM7zWdNy8w6oTTOZiiI4p-bu2sganP9L0tY4FMuAREaA50cfQ6BNW84Y3iW98oWSkHDCk0Ry0JIo9vnf704SO-pDN2uyXxgyL1kSHslD8E2YHMs0HsuFyI2Q6d2XvkgnMWcmrQcgnkCT5iGkvQzwSTX7u2J-B4GJWDrKDgib_s8g Sep 09 13:03:08.115135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:03:08.115135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:03:08.115135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:03:08.115135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:03:08.115135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:03:08.115135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:03:08.115135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: 4d8ac804454c4a268df09701c1c55ac2 Sep 09 13:03:08.115135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-582050675 Sep 09 13:03:08.115135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:03:08.115135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:03:08.116519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4d8ac804454c4a268df09701c1c55ac2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4d8ac804454c4a268df09701c1c55ac2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4d8ac804454c4a268df09701c1c55ac2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4d8ac804454c4a268df09701c1c55ac2"}]}] Sep 09 13:03:08.116519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-VolumesSnapshotsTestJSON-582050675 Sep 09 13:03:08.116519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: 4d8ac804454c4a268df09701c1c55ac2 Sep 09 13:03:08.116519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-582050675 Sep 09 13:03:08.116519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-VolumesSnapshotsTestJSON-582050675-project Sep 09 13:03:08.116519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:03:08.116519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:03:08.116519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 8263eb1f157548519990dba4c2300e91 Sep 09 13:03:08.116519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-VolumesSnapshotsTestJSON-582050675-project Sep 09 13:03:08.116519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: Sep 09 13:03:08.116519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Volume 2ca25f7a-ea72-4537-a30c-744c3035b221 could not be found. Sep 09 13:03:08.116519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': '2ca25f7a-ea72-4537-a30c-744c3035b221'} Sep 09 13:03:08.116519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:03:08.117290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:08.117290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 13:03:08.117290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 13:03:08.117290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 13:03:08.117290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 13:03:08.117290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 13:03:08.117290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 13:03:08.117290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 13:03:08.117290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 13:03:08.117290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 13:03:08.117290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 13:03:08.117290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:03:08.117290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:03:08.117290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:03:08.117290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:03:08.117290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ca25f7a-ea72-4537-a30c-744c3035b221 could not be found. (HTTP 404) (Request-ID: req-88ccaaee-8b5c-471f-a663-0a572e6b217f) Sep 09 13:03:08.117290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:08.117290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:08.117290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:08.119208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:08.119208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 13:03:08.119208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 13:03:08.119208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 13:03:08.119208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 13:03:08.119208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 13:03:08.119208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 13:03:08.119208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 13:03:08.119208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 13:03:08.119208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 13:03:08.119208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 13:03:08.119208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 13:03:08.119208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 13:03:08.119208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 13:03:08.119208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 13:03:08.119208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 13:03:08.119208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 13:03:08.119208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 13:03:08.119208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 13:03:08.120774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:03:08.120774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:03:08.120774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:03:08.120774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:03:08.120774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ca25f7a-ea72-4537-a30c-744c3035b221 could not be found. Sep 09 13:03:08.120774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:08.120774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:08.120774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:08.120774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:08.120774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:03:08.120774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:03:08.120774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:03:08.120774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:03:08.120774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 13:03:08.120774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 13:03:08.120774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:03:08.120774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:03:08.120774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 13:03:08.120774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:03:08.122059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ca25f7a-ea72-4537-a30c-744c3035b221 could not be found. Sep 09 13:03:08.122059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:08.122059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:08.122059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:08.122059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:08.122059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:03:08.122059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:03:08.122059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:03:08.122059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:03:08.122059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ca25f7a-ea72-4537-a30c-744c3035b221 could not be found. Sep 09 13:03:08.122059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:08.122059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-80bb7a9f-e4ba-4fd7-9d9c-e64e5387c084 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Returning 404 to user: Volume 2ca25f7a-ea72-4537-a30c-744c3035b221 could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:03:08.122059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-80bb7a9f-e4ba-4fd7-9d9c-e64e5387c084 tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/2ca25f7a-ea72-4537-a30c-744c3035b221" status: 404 len: 109 microversion: 2.1 time: 0.044447 Sep 09 13:03:08.122059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 400/792] 10.222.0.46 () {58 vars in 1248 bytes} [Fri Sep 9 13:03:08 2022] DELETE /compute/v2.1/os-volumes/2ca25f7a-ea72-4537-a30c-744c3035b221 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:03:08.131600 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-6197768b-ad97-4fc6-9af7-79b80a08071d tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Calling method '.version_select at 0x7f3182ede430>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:08.163595 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-6197768b-ad97-4fc6-9af7-79b80a08071d tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] HTTP exception thrown: Volume 2ca25f7a-ea72-4537-a30c-744c3035b221 could not be found. Sep 09 13:03:08.165520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-6197768b-ad97-4fc6-9af7-79b80a08071d tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Request method failure captured: Sep 09 13:03:08.165520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: GET /compute/v2.1/os-volumes/2ca25f7a-ea72-4537-a30c-744c3035b221 HTTP/1.1 Sep 09 13:03:08.165520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 13:03:08.165520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 13:03:08.165520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 13:03:08.165520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 13:03:08.165520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 13:03:08.165520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 13:03:08.165520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 13:03:08.165520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 13:03:08.165520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGzmDM7zWdNy8w6oTTOZiiI4p-bu2sganP9L0tY4FMuAREaA50cfQ6BNW84Y3iW98oWSkHDCk0Ry0JIo9vnf704SO-pDN2uyXxgyL1kSHslD8E2YHMs0HsuFyI2Q6d2XvkgnMWcmrQcgnkCT5iGkvQzwSTX7u2J-B4GJWDrKDgib_s8g Sep 09 13:03:08.165520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 13:03:08.165520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 13:03:08.165520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 13:03:08.165520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 13:03:08.165520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 13:03:08.165520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 13:03:08.165520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: 4d8ac804454c4a268df09701c1c55ac2 Sep 09 13:03:08.165520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-582050675 Sep 09 13:03:08.165520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 13:03:08.165520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 13:03:08.167123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4d8ac804454c4a268df09701c1c55ac2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4d8ac804454c4a268df09701c1c55ac2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4d8ac804454c4a268df09701c1c55ac2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4d8ac804454c4a268df09701c1c55ac2"}]}] Sep 09 13:03:08.167123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-VolumesSnapshotsTestJSON-582050675 Sep 09 13:03:08.167123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: 4d8ac804454c4a268df09701c1c55ac2 Sep 09 13:03:08.167123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-582050675 Sep 09 13:03:08.167123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-VolumesSnapshotsTestJSON-582050675-project Sep 09 13:03:08.167123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 13:03:08.167123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 13:03:08.167123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: 8263eb1f157548519990dba4c2300e91 Sep 09 13:03:08.167123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-VolumesSnapshotsTestJSON-582050675-project Sep 09 13:03:08.167123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: Sep 09 13:03:08.167123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Volume 2ca25f7a-ea72-4537-a30c-744c3035b221 could not be found. Sep 09 13:03:08.167123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'id': '2ca25f7a-ea72-4537-a30c-744c3035b221'} Sep 09 13:03:08.167123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:03:08.172804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:08.172804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 13:03:08.172804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 13:03:08.172804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 13:03:08.172804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 13:03:08.172804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 13:03:08.172804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 13:03:08.172804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 13:03:08.172804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 13:03:08.172804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 13:03:08.172804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 13:03:08.172804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:03:08.172804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:03:08.172804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:03:08.172804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:03:08.172804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ca25f7a-ea72-4537-a30c-744c3035b221 could not be found. (HTTP 404) (Request-ID: req-dc248f9a-85a4-43f8-bf53-99c6070988ea) Sep 09 13:03:08.172804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:08.172804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:08.172804 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:08.174430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:08.174430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 13:03:08.174430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 13:03:08.174430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 13:03:08.174430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 13:03:08.174430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 13:03:08.174430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 13:03:08.174430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 13:03:08.174430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 13:03:08.174430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 13:03:08.174430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 13:03:08.174430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 13:03:08.174430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 13:03:08.174430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 13:03:08.174430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 13:03:08.174430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 13:03:08.174430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 13:03:08.174430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 13:03:08.174430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 13:03:08.176152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:03:08.176152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:03:08.176152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:03:08.176152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:03:08.176152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ca25f7a-ea72-4537-a30c-744c3035b221 could not be found. Sep 09 13:03:08.176152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:08.176152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:08.176152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:08.176152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:08.176152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:03:08.176152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:03:08.176152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:03:08.176152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:03:08.176152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 13:03:08.176152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 13:03:08.176152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:03:08.176152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:03:08.176152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 13:03:08.176152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:03:08.177607 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ca25f7a-ea72-4537-a30c-744c3035b221 could not be found. Sep 09 13:03:08.177607 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:08.177607 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:08.177607 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:08.177607 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:08.177607 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:03:08.177607 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:03:08.177607 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:03:08.177607 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:03:08.177607 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ca25f7a-ea72-4537-a30c-744c3035b221 could not be found. Sep 09 13:03:08.177607 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:08.177607 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-6197768b-ad97-4fc6-9af7-79b80a08071d tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] Returning 404 to user: Volume 2ca25f7a-ea72-4537-a30c-744c3035b221 could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:03:08.177607 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-6197768b-ad97-4fc6-9af7-79b80a08071d tempest-VolumesSnapshotsTestJSON-582050675 tempest-VolumesSnapshotsTestJSON-582050675-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/2ca25f7a-ea72-4537-a30c-744c3035b221" status: 404 len: 109 microversion: 2.1 time: 0.042875 Sep 09 13:03:08.177607 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 393/793] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 13:03:08 2022] GET /compute/v2.1/os-volumes/2ca25f7a-ea72-4537-a30c-744c3035b221 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:03:08.184033 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2a70e601-887b-4ef1-a426-6041bc40a6b7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:08.184033 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2a70e601-887b-4ef1-a426-6041bc40a6b7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:08.187930 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2a70e601-887b-4ef1-a426-6041bc40a6b7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:08.188420 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2a70e601-887b-4ef1-a426-6041bc40a6b7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:08.188861 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2a70e601-887b-4ef1-a426-6041bc40a6b7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:08.189565 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2a70e601-887b-4ef1-a426-6041bc40a6b7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:08.190022 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2a70e601-887b-4ef1-a426-6041bc40a6b7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:08.190449 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2a70e601-887b-4ef1-a426-6041bc40a6b7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:08.290331 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-5497084a-d465-4169-99fa-a57c2824d4d8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:08.290966 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-5497084a-d465-4169-99fa-a57c2824d4d8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:08.293287 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:03:08.298696 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5497084a-d465-4169-99fa-a57c2824d4d8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:08.299187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5497084a-d465-4169-99fa-a57c2824d4d8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:08.299797 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5497084a-d465-4169-99fa-a57c2824d4d8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:08.300648 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5497084a-d465-4169-99fa-a57c2824d4d8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:08.301259 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5497084a-d465-4169-99fa-a57c2824d4d8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:08.301686 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5497084a-d465-4169-99fa-a57c2824d4d8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:08.357094 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2a70e601-887b-4ef1-a426-6041bc40a6b7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:08.365356 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2a70e601-887b-4ef1-a426-6041bc40a6b7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:08.366809 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2a70e601-887b-4ef1-a426-6041bc40a6b7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:08.367973 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2a70e601-887b-4ef1-a426-6041bc40a6b7 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1720 microversion: 2.20 time: 0.196446 Sep 09 13:03:08.368680 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 401/794] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:03:08 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1720 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:03:08.505424 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-5497084a-d465-4169-99fa-a57c2824d4d8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:08.515722 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-5497084a-d465-4169-99fa-a57c2824d4d8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1259 microversion: 2.1 time: 0.229474 Sep 09 13:03:08.531508 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 394/795] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:08 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1259 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:09.394368 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-aa1304ed-4efc-4720-b6f2-6c889a800f42 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:09.395695 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-aa1304ed-4efc-4720-b6f2-6c889a800f42 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:09.402853 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aa1304ed-4efc-4720-b6f2-6c889a800f42 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:09.406559 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aa1304ed-4efc-4720-b6f2-6c889a800f42 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:09.407894 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aa1304ed-4efc-4720-b6f2-6c889a800f42 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:09.409892 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aa1304ed-4efc-4720-b6f2-6c889a800f42 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:09.410700 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aa1304ed-4efc-4720-b6f2-6c889a800f42 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:09.411288 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aa1304ed-4efc-4720-b6f2-6c889a800f42 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:09.516979 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-aa1304ed-4efc-4720-b6f2-6c889a800f42 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:09.548876 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-88ff53c1-3f89-4018-8265-0eaf21ddf87d tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:09.549715 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-88ff53c1-3f89-4018-8265-0eaf21ddf87d tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:09.553084 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-aa1304ed-4efc-4720-b6f2-6c889a800f42 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:09.566474 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-aa1304ed-4efc-4720-b6f2-6c889a800f42 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:09.570765 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-aa1304ed-4efc-4720-b6f2-6c889a800f42 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1654 microversion: 2.20 time: 0.180544 Sep 09 13:03:09.574296 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 402/796] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:03:09 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1654 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:03:09.583518 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88ff53c1-3f89-4018-8265-0eaf21ddf87d tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:09.585852 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88ff53c1-3f89-4018-8265-0eaf21ddf87d tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:09.586309 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88ff53c1-3f89-4018-8265-0eaf21ddf87d tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:09.587065 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88ff53c1-3f89-4018-8265-0eaf21ddf87d tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:09.592576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88ff53c1-3f89-4018-8265-0eaf21ddf87d tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:09.593047 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88ff53c1-3f89-4018-8265-0eaf21ddf87d tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:09.595136 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-d156f3f5-7bd5-4add-b933-12d317659d6e req-53e19de9-e07f-461d-9634-6e1e6422d9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37305bac-ecac-4f89-a340-55d5ffc7a775", "name": "network-vif-deleted", "tag": "10813693-1d59-4806-bfad-10fa8cfeba3b"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:03:09.624720 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-d156f3f5-7bd5-4add-b933-12d317659d6e req-53e19de9-e07f-461d-9634-6e1e6422d9e0 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:09.627445 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-d156f3f5-7bd5-4add-b933-12d317659d6e req-53e19de9-e07f-461d-9634-6e1e6422d9e0 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:09.628085 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-d156f3f5-7bd5-4add-b933-12d317659d6e req-53e19de9-e07f-461d-9634-6e1e6422d9e0 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:09.657415 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-d156f3f5-7bd5-4add-b933-12d317659d6e req-53e19de9-e07f-461d-9634-6e1e6422d9e0 service nova] Creating event network-vif-deleted:10813693-1d59-4806-bfad-10fa8cfeba3b for instance 37305bac-ecac-4f89-a340-55d5ffc7a775 on hv-cinder-81322 Sep 09 13:03:09.667012 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-d156f3f5-7bd5-4add-b933-12d317659d6e req-53e19de9-e07f-461d-9634-6e1e6422d9e0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086765 Sep 09 13:03:09.667983 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 403/797] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:03:09.854583 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-88ff53c1-3f89-4018-8265-0eaf21ddf87d tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:09.865836 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-88ff53c1-3f89-4018-8265-0eaf21ddf87d tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1259 microversion: 2.1 time: 0.326296 Sep 09 13:03:09.866422 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 395/798] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:09 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1259 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:03:10.602825 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-2495a5d4-a004-477d-99ab-94b5a690a113 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:10.604132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-2495a5d4-a004-477d-99ab-94b5a690a113 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:10.611548 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2495a5d4-a004-477d-99ab-94b5a690a113 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:10.612039 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2495a5d4-a004-477d-99ab-94b5a690a113 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:10.612479 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2495a5d4-a004-477d-99ab-94b5a690a113 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:10.613225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2495a5d4-a004-477d-99ab-94b5a690a113 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:10.613624 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2495a5d4-a004-477d-99ab-94b5a690a113 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:10.617873 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2495a5d4-a004-477d-99ab-94b5a690a113 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:10.649794 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2495a5d4-a004-477d-99ab-94b5a690a113 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:10.650467 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2495a5d4-a004-477d-99ab-94b5a690a113 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:10.651081 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2495a5d4-a004-477d-99ab-94b5a690a113 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:10.651529 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.objects.instance [None req-2495a5d4-a004-477d-99ab-94b5a690a113 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lazy-loading 'fault' on Instance uuid 37305bac-ecac-4f89-a340-55d5ffc7a775 {{(pid=127772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:03:10.673503 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8e1baada-c7c5-4800-9974-b5d84c68c418 tempest-VolumesGetTestJSON-1639915520 tempest-VolumesGetTestJSON-1639915520-project] Action: 'create', calling method: .version_select at 0x7f3182f67ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1744859706", "metadata": {"Type": "work"}}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:03:10.717253 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-2495a5d4-a004-477d-99ab-94b5a690a113 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:10.727820 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-2495a5d4-a004-477d-99ab-94b5a690a113 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:10.727820 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-2495a5d4-a004-477d-99ab-94b5a690a113 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec951604cde4768beb02906caf6d7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8880382269b94daa8a25f92178a478d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:10.737982 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-2495a5d4-a004-477d-99ab-94b5a690a113 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 200 len: 1370 microversion: 2.20 time: 0.129250 Sep 09 13:03:10.740152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 396/799] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:03:10 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 1370 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:03:10.888808 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-738e1b10-9c33-4c32-8b99-1a6e761f8a13 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:10.889476 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-738e1b10-9c33-4c32-8b99-1a6e761f8a13 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:10.896047 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-738e1b10-9c33-4c32-8b99-1a6e761f8a13 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:10.896555 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-738e1b10-9c33-4c32-8b99-1a6e761f8a13 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:10.896988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-738e1b10-9c33-4c32-8b99-1a6e761f8a13 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:10.897684 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-738e1b10-9c33-4c32-8b99-1a6e761f8a13 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:10.898306 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-738e1b10-9c33-4c32-8b99-1a6e761f8a13 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:10.898756 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-738e1b10-9c33-4c32-8b99-1a6e761f8a13 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:11.066396 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-738e1b10-9c33-4c32-8b99-1a6e761f8a13 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:11.076120 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-738e1b10-9c33-4c32-8b99-1a6e761f8a13 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1259 microversion: 2.1 time: 0.190573 Sep 09 13:03:11.077339 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 397/800] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:10 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:11.097941 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-38bebda8-35a8-4764-aab1-7fa12c3559a6 req-d948a82b-e756-4b4d-b88f-42193181963d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10884cc0-9f01-425e-8d5f-9e0727a68b5e", "name": "network-vif-plugged", "status": "completed", "tag": "b5735773-f9c8-4cb1-80c8-146eef0519fe"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:03:11.115548 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-38bebda8-35a8-4764-aab1-7fa12c3559a6 req-d948a82b-e756-4b4d-b88f-42193181963d service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:11.116423 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-38bebda8-35a8-4764-aab1-7fa12c3559a6 req-d948a82b-e756-4b4d-b88f-42193181963d service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:11.117033 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-38bebda8-35a8-4764-aab1-7fa12c3559a6 req-d948a82b-e756-4b4d-b88f-42193181963d service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:11.141001 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-38bebda8-35a8-4764-aab1-7fa12c3559a6 req-d948a82b-e756-4b4d-b88f-42193181963d service nova] Creating event network-vif-plugged:b5735773-f9c8-4cb1-80c8-146eef0519fe for instance 10884cc0-9f01-425e-8d5f-9e0727a68b5e on hv-cinder-81322 Sep 09 13:03:11.146102 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-38bebda8-35a8-4764-aab1-7fa12c3559a6 req-d948a82b-e756-4b4d-b88f-42193181963d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051677 Sep 09 13:03:11.146719 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 398/801] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:03:11.371649 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-8e1baada-c7c5-4800-9974-b5d84c68c418 tempest-VolumesGetTestJSON-1639915520 tempest-VolumesGetTestJSON-1639915520-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.845994 Sep 09 13:03:11.373058 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 404/802] 10.222.0.46 () {60 vars in 1156 bytes} [Fri Sep 9 13:03:10 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 848 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 13:03:11.386597 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-9c0b651c-f8ba-4401-97be-f842111495ee tempest-VolumesGetTestJSON-1639915520 tempest-VolumesGetTestJSON-1639915520-project] Calling method '.version_select at 0x7f3182ede1f0>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:11.461904 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-9c0b651c-f8ba-4401-97be-f842111495ee tempest-VolumesGetTestJSON-1639915520 tempest-VolumesGetTestJSON-1639915520-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ba6cb182-9fa7-480d-905a-75c1e2b0d672" status: 200 len: 353 microversion: 2.1 time: 0.079738 Sep 09 13:03:11.462473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 399/803] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 13:03:11 2022] GET /compute/v2.1/os-volumes/ba6cb182-9fa7-480d-905a-75c1e2b0d672 => generated 353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:03:11.766459 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ea5f0960-21d8-4386-93a6-cd809db698ec tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:11.767215 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ea5f0960-21d8-4386-93a6-cd809db698ec tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:11.773939 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ea5f0960-21d8-4386-93a6-cd809db698ec tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:11.774420 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ea5f0960-21d8-4386-93a6-cd809db698ec tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:11.774890 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ea5f0960-21d8-4386-93a6-cd809db698ec tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:11.775580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ea5f0960-21d8-4386-93a6-cd809db698ec tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:11.776035 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ea5f0960-21d8-4386-93a6-cd809db698ec tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:11.776463 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ea5f0960-21d8-4386-93a6-cd809db698ec tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:11.791601 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-ea5f0960-21d8-4386-93a6-cd809db698ec tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] HTTP exception thrown: Instance 37305bac-ecac-4f89-a340-55d5ffc7a775 could not be found. Sep 09 13:03:11.793248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ea5f0960-21d8-4386-93a6-cd809db698ec tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Request method failure captured: Sep 09 13:03:11.793248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 HTTP/1.1 Sep 09 13:03:11.793248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:03:11.793248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:03:11.793248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:03:11.793248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:03:11.793248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:03:11.793248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:03:11.793248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:03:11.793248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:03:11.793248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzgGc301qUdiFdvHsxfIR2ZHpj_jK1XgnS94H4zqb479BmFK7vk7y9IInkTzPaeassYzBWwIhwUIsIfb8PTxLo46qNMb8y_Xt7zHJgKoPsAssNKlApWDbag0xk_ORmkp1xzj2WRHJwvqOt_bRgXZoss1Uwz6Dfh7FIge5PagJd2rxig Sep 09 13:03:11.793248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:03:11.793248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:03:11.793248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:03:11.793248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:03:11.793248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 13:03:11.793248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:03:11.793248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:03:11.793248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: 8880382269b94daa8a25f92178a478d5 Sep 09 13:03:11.793248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1891493230 Sep 09 13:03:11.793248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:03:11.793248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:03:11.795459 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8880382269b94daa8a25f92178a478d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8880382269b94daa8a25f92178a478d5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8880382269b94daa8a25f92178a478d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8880382269b94daa8a25f92178a478d5"}]}] Sep 09 13:03:11.795459 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1891493230 Sep 09 13:03:11.795459 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: 8880382269b94daa8a25f92178a478d5 Sep 09 13:03:11.795459 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1891493230 Sep 09 13:03:11.795459 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-AttachVolumeShelveTestJSON-1891493230-project Sep 09 13:03:11.795459 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:03:11.795459 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:03:11.795459 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 6ec951604cde4768beb02906caf6d7c2 Sep 09 13:03:11.795459 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1891493230-project Sep 09 13:03:11.795459 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:03:11.795459 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance 37305bac-ecac-4f89-a340-55d5ffc7a775 could not be found. Sep 09 13:03:11.795459 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': '37305bac-ecac-4f89-a340-55d5ffc7a775'} Sep 09 13:03:11.796330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:03:11.796330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:11.796330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:03:11.796330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:03:11.796330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:03:11.796330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:03:11.796330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:03:11.796330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:03:11.796330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:03:11.796330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:03:11.796330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37305bac-ecac-4f89-a340-55d5ffc7a775 could not be found. Sep 09 13:03:11.796330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:11.796330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:11.796330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:11.796330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:11.796330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:03:11.796330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:03:11.796330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:03:11.796330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:03:11.796330 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:03:11.797758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:03:11.797758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:03:11.797758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:03:11.797758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:03:11.797758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:03:11.797758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:03:11.797758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:03:11.797758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37305bac-ecac-4f89-a340-55d5ffc7a775 could not be found. Sep 09 13:03:11.797758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:11.797758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:11.797758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:11.797758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:11.797758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:03:11.797758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:03:11.797758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:03:11.797758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:03:11.797758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37305bac-ecac-4f89-a340-55d5ffc7a775 could not be found. Sep 09 13:03:11.797758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:11.802737 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ea5f0960-21d8-4386-93a6-cd809db698ec tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Returning 404 to user: Instance 37305bac-ecac-4f89-a340-55d5ffc7a775 could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:03:11.802737 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ea5f0960-21d8-4386-93a6-cd809db698ec tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 404 len: 111 microversion: 2.20 time: 0.033969 Sep 09 13:03:11.802737 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 405/804] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:03:11 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 13:03:11.804924 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-4bca4752-f673-46e2-b18c-12c53556884d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '.version_select at 0x7f3182f9e8b0>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:11.863108 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-4bca4752-f673-46e2-b18c-12c53556884d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1012367090" status: 204 len: 0 microversion: 2.20 time: 0.062544 Sep 09 13:03:11.863692 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 400/805] 10.222.0.46 () {60 vars in 1262 bytes} [Fri Sep 9 13:03:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1012367090 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 13:03:12.105407 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e290d3d0-8992-40ee-8673-dc12db7bd2fb tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:12.106992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-e290d3d0-8992-40ee-8673-dc12db7bd2fb tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:12.114304 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e290d3d0-8992-40ee-8673-dc12db7bd2fb tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:12.114876 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e290d3d0-8992-40ee-8673-dc12db7bd2fb tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:12.115359 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e290d3d0-8992-40ee-8673-dc12db7bd2fb tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:12.116614 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e290d3d0-8992-40ee-8673-dc12db7bd2fb tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:12.117452 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e290d3d0-8992-40ee-8673-dc12db7bd2fb tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:12.118029 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e290d3d0-8992-40ee-8673-dc12db7bd2fb tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:12.367062 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e290d3d0-8992-40ee-8673-dc12db7bd2fb tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:12.375969 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-e290d3d0-8992-40ee-8673-dc12db7bd2fb tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1259 microversion: 2.1 time: 0.277034 Sep 09 13:03:12.387444 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 406/806] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:12 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1259 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:12.477679 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-44fc36e7-65d0-4c3e-8ab6-677ba9384328 tempest-VolumesGetTestJSON-1639915520 tempest-VolumesGetTestJSON-1639915520-project] Calling method '.version_select at 0x7f3182eb28b0>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:12.547584 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-44fc36e7-65d0-4c3e-8ab6-677ba9384328 tempest-VolumesGetTestJSON-1639915520 tempest-VolumesGetTestJSON-1639915520-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ba6cb182-9fa7-480d-905a-75c1e2b0d672" status: 200 len: 354 microversion: 2.1 time: 0.074415 Sep 09 13:03:12.548150 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 401/807] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 13:03:12 2022] GET /compute/v2.1/os-volumes/ba6cb182-9fa7-480d-905a-75c1e2b0d672 => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:03:12.561448 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e96d9191-214a-4cfa-a2c7-a1a022871c78 tempest-VolumesGetTestJSON-1639915520 tempest-VolumesGetTestJSON-1639915520-project] Calling method '.version_select at 0x7f31830d5e50>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:12.612756 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-e96d9191-214a-4cfa-a2c7-a1a022871c78 tempest-VolumesGetTestJSON-1639915520 tempest-VolumesGetTestJSON-1639915520-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ba6cb182-9fa7-480d-905a-75c1e2b0d672" status: 200 len: 354 microversion: 2.1 time: 0.055536 Sep 09 13:03:12.613408 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 407/808] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 13:03:12 2022] GET /compute/v2.1/os-volumes/ba6cb182-9fa7-480d-905a-75c1e2b0d672 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:03:12.632176 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-92fe4304-c4d3-40ad-a7bb-de7ce0de5cea tempest-VolumesGetTestJSON-1639915520 tempest-VolumesGetTestJSON-1639915520-project] Calling method '.version_select at 0x7f3182f02a60>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:12.864792 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-92fe4304-c4d3-40ad-a7bb-de7ce0de5cea tempest-VolumesGetTestJSON-1639915520 tempest-VolumesGetTestJSON-1639915520-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/ba6cb182-9fa7-480d-905a-75c1e2b0d672" status: 202 len: 0 microversion: 2.1 time: 0.236336 Sep 09 13:03:12.866830 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 402/809] 10.222.0.46 () {58 vars in 1248 bytes} [Fri Sep 9 13:03:12 2022] DELETE /compute/v2.1/os-volumes/ba6cb182-9fa7-480d-905a-75c1e2b0d672 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:03:12.875461 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ceadb2c9-c02f-41f4-8f01-2bf7d30169b2 tempest-VolumesGetTestJSON-1639915520 tempest-VolumesGetTestJSON-1639915520-project] Calling method '.version_select at 0x7f3182f673a0>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:12.923264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ceadb2c9-c02f-41f4-8f01-2bf7d30169b2 tempest-VolumesGetTestJSON-1639915520 tempest-VolumesGetTestJSON-1639915520-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ba6cb182-9fa7-480d-905a-75c1e2b0d672" status: 200 len: 353 microversion: 2.1 time: 0.052281 Sep 09 13:03:12.923833 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 408/810] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 13:03:12 2022] GET /compute/v2.1/os-volumes/ba6cb182-9fa7-480d-905a-75c1e2b0d672 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:03:13.400349 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ffe2cad5-687e-4bc1-bf11-66eab6de24b5 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:13.401120 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-ffe2cad5-687e-4bc1-bf11-66eab6de24b5 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:13.408077 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ffe2cad5-687e-4bc1-bf11-66eab6de24b5 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:13.408573 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ffe2cad5-687e-4bc1-bf11-66eab6de24b5 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:13.409009 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ffe2cad5-687e-4bc1-bf11-66eab6de24b5 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:13.409707 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ffe2cad5-687e-4bc1-bf11-66eab6de24b5 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:13.410167 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ffe2cad5-687e-4bc1-bf11-66eab6de24b5 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:13.410621 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ffe2cad5-687e-4bc1-bf11-66eab6de24b5 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:13.549096 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ffe2cad5-687e-4bc1-bf11-66eab6de24b5 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:13.556756 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-ffe2cad5-687e-4bc1-bf11-66eab6de24b5 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1444 microversion: 2.1 time: 0.160334 Sep 09 13:03:13.557312 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 403/811] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:13 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:13.582401 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8209f566-ffea-49e8-8250-8a1d653c00ce tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:13.583315 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-8209f566-ffea-49e8-8250-8a1d653c00ce tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:13.590644 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8209f566-ffea-49e8-8250-8a1d653c00ce tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:13.591366 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8209f566-ffea-49e8-8250-8a1d653c00ce tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:13.591990 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8209f566-ffea-49e8-8250-8a1d653c00ce tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:13.592853 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8209f566-ffea-49e8-8250-8a1d653c00ce tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:13.593308 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8209f566-ffea-49e8-8250-8a1d653c00ce tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:13.593757 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8209f566-ffea-49e8-8250-8a1d653c00ce tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:13.763257 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-8209f566-ffea-49e8-8250-8a1d653c00ce tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:13.771183 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-8209f566-ffea-49e8-8250-8a1d653c00ce tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1444 microversion: 2.1 time: 0.194149 Sep 09 13:03:13.771747 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 409/812] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:13 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1444 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:13.937937 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-88300bb7-e43b-4f12-bb70-34c3872927b5 tempest-VolumesGetTestJSON-1639915520 tempest-VolumesGetTestJSON-1639915520-project] Calling method '.version_select at 0x7f3182e963a0>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:13.967600 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-88300bb7-e43b-4f12-bb70-34c3872927b5 tempest-VolumesGetTestJSON-1639915520 tempest-VolumesGetTestJSON-1639915520-project] HTTP exception thrown: Volume ba6cb182-9fa7-480d-905a-75c1e2b0d672 could not be found. Sep 09 13:03:13.969717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-88300bb7-e43b-4f12-bb70-34c3872927b5 tempest-VolumesGetTestJSON-1639915520 tempest-VolumesGetTestJSON-1639915520-project] Request method failure captured: Sep 09 13:03:13.969717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: GET /compute/v2.1/os-volumes/ba6cb182-9fa7-480d-905a-75c1e2b0d672 HTTP/1.1 Sep 09 13:03:13.969717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 13:03:13.969717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 13:03:13.969717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 13:03:13.969717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 13:03:13.969717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 13:03:13.969717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 13:03:13.969717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 13:03:13.969717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 13:03:13.969717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGzmOKCCiG-KifExliD7B3CMuGYYJcv8bSFGBzoc1CMUxRaiOfncHuA8j1rPUU5ZOrzwR62ngHMDIRftJJe5abixn1PBuGXtWR6Psel8cddCHyTBMIE4km6gocJ2oU1aOWjh2O-Zyh6WQIhHRt_fbE7eAyTq6ter9nprjr-VncVUGB_0 Sep 09 13:03:13.969717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 13:03:13.969717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 13:03:13.969717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 13:03:13.969717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 13:03:13.969717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 13:03:13.969717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 13:03:13.969717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: 18eb044852c6471e83c6b4aa62d6ce96 Sep 09 13:03:13.969717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-VolumesGetTestJSON-1639915520 Sep 09 13:03:13.969717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 13:03:13.969717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 13:03:13.971131 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/18eb044852c6471e83c6b4aa62d6ce96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_18eb044852c6471e83c6b4aa62d6ce96", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18eb044852c6471e83c6b4aa62d6ce96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18eb044852c6471e83c6b4aa62d6ce96"}]}] Sep 09 13:03:13.971131 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-VolumesGetTestJSON-1639915520 Sep 09 13:03:13.971131 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: 18eb044852c6471e83c6b4aa62d6ce96 Sep 09 13:03:13.971131 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-VolumesGetTestJSON-1639915520 Sep 09 13:03:13.971131 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-VolumesGetTestJSON-1639915520-project Sep 09 13:03:13.971131 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 13:03:13.971131 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 13:03:13.971131 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: e877ed5efb164c91a5d5cdaaed2f25e6 Sep 09 13:03:13.971131 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-VolumesGetTestJSON-1639915520-project Sep 09 13:03:13.971131 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: Sep 09 13:03:13.971131 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Volume ba6cb182-9fa7-480d-905a-75c1e2b0d672 could not be found. Sep 09 13:03:13.971131 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'id': 'ba6cb182-9fa7-480d-905a-75c1e2b0d672'} Sep 09 13:03:13.971131 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:03:13.972137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:13.972137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 13:03:13.972137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 13:03:13.972137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 13:03:13.972137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 13:03:13.972137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 13:03:13.972137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 13:03:13.972137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 13:03:13.972137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 13:03:13.972137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 13:03:13.972137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 13:03:13.972137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:03:13.972137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:03:13.972137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:03:13.972137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:03:13.972137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ba6cb182-9fa7-480d-905a-75c1e2b0d672 could not be found. (HTTP 404) (Request-ID: req-3319c08a-af17-4ba3-9c4a-f48551ff9eb1) Sep 09 13:03:13.972137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:13.972137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:13.972137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:13.973646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:13.973646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 13:03:13.973646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 13:03:13.973646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 13:03:13.973646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 13:03:13.973646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 13:03:13.973646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 13:03:13.973646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 13:03:13.973646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 13:03:13.973646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 13:03:13.973646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 13:03:13.973646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 13:03:13.973646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 13:03:13.973646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 13:03:13.973646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 13:03:13.973646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 13:03:13.973646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 13:03:13.973646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 13:03:13.973646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 13:03:13.975889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:03:13.975889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:03:13.975889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:03:13.975889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:03:13.975889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ba6cb182-9fa7-480d-905a-75c1e2b0d672 could not be found. Sep 09 13:03:13.975889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:13.975889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:13.975889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:13.975889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:13.975889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:03:13.975889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:03:13.975889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:03:13.975889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:03:13.975889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 13:03:13.975889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 13:03:13.975889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:03:13.975889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:03:13.975889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 13:03:13.975889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:03:13.978182 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ba6cb182-9fa7-480d-905a-75c1e2b0d672 could not be found. Sep 09 13:03:13.978182 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:13.978182 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:13.978182 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:13.978182 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:13.978182 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:03:13.978182 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:03:13.978182 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:03:13.978182 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:03:13.978182 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ba6cb182-9fa7-480d-905a-75c1e2b0d672 could not be found. Sep 09 13:03:13.978182 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:13.978182 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-88300bb7-e43b-4f12-bb70-34c3872927b5 tempest-VolumesGetTestJSON-1639915520 tempest-VolumesGetTestJSON-1639915520-project] Returning 404 to user: Volume ba6cb182-9fa7-480d-905a-75c1e2b0d672 could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:03:13.978182 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-88300bb7-e43b-4f12-bb70-34c3872927b5 tempest-VolumesGetTestJSON-1639915520 tempest-VolumesGetTestJSON-1639915520-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ba6cb182-9fa7-480d-905a-75c1e2b0d672" status: 404 len: 109 microversion: 2.1 time: 0.037839 Sep 09 13:03:13.978182 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 404/813] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 13:03:13 2022] GET /compute/v2.1/os-volumes/ba6cb182-9fa7-480d-905a-75c1e2b0d672 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:03:14.088453 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d1573dcb-28c8-421c-93a0-5bc1ba1da99a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:14.089892 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-d1573dcb-28c8-421c-93a0-5bc1ba1da99a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:14.099434 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d1573dcb-28c8-421c-93a0-5bc1ba1da99a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:14.099924 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d1573dcb-28c8-421c-93a0-5bc1ba1da99a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:14.100368 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d1573dcb-28c8-421c-93a0-5bc1ba1da99a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:14.101077 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d1573dcb-28c8-421c-93a0-5bc1ba1da99a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:14.101781 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d1573dcb-28c8-421c-93a0-5bc1ba1da99a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:14.102223 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d1573dcb-28c8-421c-93a0-5bc1ba1da99a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:14.118795 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-d1573dcb-28c8-421c-93a0-5bc1ba1da99a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] HTTP exception thrown: Instance 37305bac-ecac-4f89-a340-55d5ffc7a775 could not be found. Sep 09 13:03:14.121658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d1573dcb-28c8-421c-93a0-5bc1ba1da99a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Request method failure captured: Sep 09 13:03:14.121658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: DELETE /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 HTTP/1.1 Sep 09 13:03:14.121658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:03:14.121658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:03:14.121658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:03:14.121658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:03:14.121658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:03:14.121658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:03:14.121658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:03:14.121658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:03:14.121658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzgGc301qUdiFdvHsxfIR2ZHpj_jK1XgnS94H4zqb479BmFK7vk7y9IInkTzPaeassYzBWwIhwUIsIfb8PTxLo46qNMb8y_Xt7zHJgKoPsAssNKlApWDbag0xk_ORmkp1xzj2WRHJwvqOt_bRgXZoss1Uwz6Dfh7FIge5PagJd2rxig Sep 09 13:03:14.121658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:03:14.121658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:03:14.121658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:03:14.121658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:03:14.121658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 13:03:14.121658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:03:14.121658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:03:14.121658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: 8880382269b94daa8a25f92178a478d5 Sep 09 13:03:14.121658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1891493230 Sep 09 13:03:14.121658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:03:14.121658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:03:14.123666 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8880382269b94daa8a25f92178a478d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8880382269b94daa8a25f92178a478d5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8880382269b94daa8a25f92178a478d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8880382269b94daa8a25f92178a478d5"}]}] Sep 09 13:03:14.123666 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1891493230 Sep 09 13:03:14.123666 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: 8880382269b94daa8a25f92178a478d5 Sep 09 13:03:14.123666 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1891493230 Sep 09 13:03:14.123666 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-AttachVolumeShelveTestJSON-1891493230-project Sep 09 13:03:14.123666 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:03:14.123666 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:03:14.123666 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 6ec951604cde4768beb02906caf6d7c2 Sep 09 13:03:14.123666 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1891493230-project Sep 09 13:03:14.123666 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:03:14.123666 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance 37305bac-ecac-4f89-a340-55d5ffc7a775 could not be found. Sep 09 13:03:14.123666 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': '37305bac-ecac-4f89-a340-55d5ffc7a775'} Sep 09 13:03:14.124468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:03:14.124468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:14.124468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:03:14.124468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:03:14.124468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:03:14.124468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:03:14.124468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:03:14.124468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:03:14.124468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:03:14.124468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:03:14.124468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37305bac-ecac-4f89-a340-55d5ffc7a775 could not be found. Sep 09 13:03:14.124468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:14.124468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:14.124468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:14.124468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:14.124468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:03:14.124468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:03:14.124468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:03:14.124468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:03:14.124468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:03:14.126147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:03:14.126147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 13:03:14.126147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 13:03:14.126147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 13:03:14.126147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 13:03:14.126147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:03:14.126147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:03:14.126147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:03:14.126147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:03:14.126147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37305bac-ecac-4f89-a340-55d5ffc7a775 could not be found. Sep 09 13:03:14.126147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:14.126147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:14.126147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:14.126147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:14.126147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:03:14.126147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:03:14.126147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:03:14.126147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:03:14.126147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37305bac-ecac-4f89-a340-55d5ffc7a775 could not be found. Sep 09 13:03:14.126147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:14.128680 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d1573dcb-28c8-421c-93a0-5bc1ba1da99a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Returning 404 to user: Instance 37305bac-ecac-4f89-a340-55d5ffc7a775 could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:03:14.128680 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d1573dcb-28c8-421c-93a0-5bc1ba1da99a tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "DELETE /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 404 len: 111 microversion: 2.20 time: 0.039643 Sep 09 13:03:14.128680 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 410/814] 10.222.0.46 () {60 vars in 1280 bytes} [Fri Sep 9 13:03:14 2022] DELETE /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 13:03:14.130932 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-57ef671a-1e16-4418-b1c5-fba309078382 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:14.131551 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-57ef671a-1e16-4418-b1c5-fba309078382 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 37305bac-ecac-4f89-a340-55d5ffc7a775] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:14.139463 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-57ef671a-1e16-4418-b1c5-fba309078382 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:14.139946 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-57ef671a-1e16-4418-b1c5-fba309078382 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:14.140384 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-57ef671a-1e16-4418-b1c5-fba309078382 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:14.141092 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-57ef671a-1e16-4418-b1c5-fba309078382 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:14.141546 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-57ef671a-1e16-4418-b1c5-fba309078382 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:14.141981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-57ef671a-1e16-4418-b1c5-fba309078382 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:14.156064 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-57ef671a-1e16-4418-b1c5-fba309078382 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] HTTP exception thrown: Instance 37305bac-ecac-4f89-a340-55d5ffc7a775 could not be found. Sep 09 13:03:14.157661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-57ef671a-1e16-4418-b1c5-fba309078382 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Request method failure captured: Sep 09 13:03:14.157661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 HTTP/1.1 Sep 09 13:03:14.157661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 13:03:14.157661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 13:03:14.157661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 13:03:14.157661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 13:03:14.157661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 13:03:14.157661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 13:03:14.157661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 13:03:14.157661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 13:03:14.157661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGzgGc301qUdiFdvHsxfIR2ZHpj_jK1XgnS94H4zqb479BmFK7vk7y9IInkTzPaeassYzBWwIhwUIsIfb8PTxLo46qNMb8y_Xt7zHJgKoPsAssNKlApWDbag0xk_ORmkp1xzj2WRHJwvqOt_bRgXZoss1Uwz6Dfh7FIge5PagJd2rxig Sep 09 13:03:14.157661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 13:03:14.157661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 13:03:14.157661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 13:03:14.157661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 13:03:14.157661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 13:03:14.157661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 13:03:14.157661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 13:03:14.157661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: 8880382269b94daa8a25f92178a478d5 Sep 09 13:03:14.157661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1891493230 Sep 09 13:03:14.157661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 13:03:14.157661 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 13:03:14.159383 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8880382269b94daa8a25f92178a478d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8880382269b94daa8a25f92178a478d5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8880382269b94daa8a25f92178a478d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8880382269b94daa8a25f92178a478d5"}]}] Sep 09 13:03:14.159383 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1891493230 Sep 09 13:03:14.159383 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: 8880382269b94daa8a25f92178a478d5 Sep 09 13:03:14.159383 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1891493230 Sep 09 13:03:14.159383 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-AttachVolumeShelveTestJSON-1891493230-project Sep 09 13:03:14.159383 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 13:03:14.159383 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 13:03:14.159383 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: 6ec951604cde4768beb02906caf6d7c2 Sep 09 13:03:14.159383 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1891493230-project Sep 09 13:03:14.159383 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: > Sep 09 13:03:14.159383 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Instance 37305bac-ecac-4f89-a340-55d5ffc7a775 could not be found. Sep 09 13:03:14.159383 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'id': '37305bac-ecac-4f89-a340-55d5ffc7a775'} Sep 09 13:03:14.160292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:03:14.160292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:14.160292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:03:14.160292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:03:14.160292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:03:14.160292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:03:14.160292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:03:14.160292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:03:14.160292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:03:14.160292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:03:14.160292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37305bac-ecac-4f89-a340-55d5ffc7a775 could not be found. Sep 09 13:03:14.160292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:14.160292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:14.160292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:14.160292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:14.160292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:03:14.160292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:03:14.160292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:03:14.160292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:03:14.160292 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:03:14.161887 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:03:14.161887 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:03:14.161887 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:03:14.161887 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:03:14.161887 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:03:14.161887 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:03:14.161887 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:03:14.161887 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37305bac-ecac-4f89-a340-55d5ffc7a775 could not be found. Sep 09 13:03:14.161887 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:14.161887 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:14.161887 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:14.161887 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:14.161887 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:03:14.161887 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:03:14.161887 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:03:14.161887 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:03:14.161887 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37305bac-ecac-4f89-a340-55d5ffc7a775 could not be found. Sep 09 13:03:14.161887 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:14.163302 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-57ef671a-1e16-4418-b1c5-fba309078382 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Returning 404 to user: Instance 37305bac-ecac-4f89-a340-55d5ffc7a775 could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:03:14.163302 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-57ef671a-1e16-4418-b1c5-fba309078382 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775" status: 404 len: 111 microversion: 2.20 time: 0.032779 Sep 09 13:03:14.163302 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 405/815] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:03:14 2022] GET /compute/v2.1/servers/37305bac-ecac-4f89-a340-55d5ffc7a775 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 13:03:15.526378 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2f6b09e9-0c23-4891-8d7d-f0fecd2abd8d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:15.531997 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2f6b09e9-0c23-4891-8d7d-f0fecd2abd8d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:15.533663 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2f6b09e9-0c23-4891-8d7d-f0fecd2abd8d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:15.534152 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2f6b09e9-0c23-4891-8d7d-f0fecd2abd8d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:15.534652 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2f6b09e9-0c23-4891-8d7d-f0fecd2abd8d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:15.535351 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2f6b09e9-0c23-4891-8d7d-f0fecd2abd8d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:15.535807 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2f6b09e9-0c23-4891-8d7d-f0fecd2abd8d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:15.536237 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2f6b09e9-0c23-4891-8d7d-f0fecd2abd8d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:15.550310 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-2f6b09e9-0c23-4891-8d7d-f0fecd2abd8d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] HTTP exception thrown: Instance 78dad9a3-ac85-4014-829c-986cca18c8b1 could not be found. Sep 09 13:03:15.552068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2f6b09e9-0c23-4891-8d7d-f0fecd2abd8d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Request method failure captured: Sep 09 13:03:15.552068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: DELETE /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 HTTP/1.1 Sep 09 13:03:15.552068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:03:15.552068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:03:15.552068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:03:15.552068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:03:15.552068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:03:15.552068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:03:15.552068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:03:15.552068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:03:15.552068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzgGc301qUdiFdvHsxfIR2ZHpj_jK1XgnS94H4zqb479BmFK7vk7y9IInkTzPaeassYzBWwIhwUIsIfb8PTxLo46qNMb8y_Xt7zHJgKoPsAssNKlApWDbag0xk_ORmkp1xzj2WRHJwvqOt_bRgXZoss1Uwz6Dfh7FIge5PagJd2rxig Sep 09 13:03:15.552068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:03:15.552068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:03:15.552068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:03:15.552068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:03:15.552068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 13:03:15.552068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:03:15.552068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:03:15.552068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: 8880382269b94daa8a25f92178a478d5 Sep 09 13:03:15.552068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1891493230 Sep 09 13:03:15.552068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:03:15.552068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:03:15.553545 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8880382269b94daa8a25f92178a478d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8880382269b94daa8a25f92178a478d5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8880382269b94daa8a25f92178a478d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8880382269b94daa8a25f92178a478d5"}]}] Sep 09 13:03:15.553545 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1891493230 Sep 09 13:03:15.553545 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: 8880382269b94daa8a25f92178a478d5 Sep 09 13:03:15.553545 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1891493230 Sep 09 13:03:15.553545 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-AttachVolumeShelveTestJSON-1891493230-project Sep 09 13:03:15.553545 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:03:15.553545 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:03:15.553545 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 6ec951604cde4768beb02906caf6d7c2 Sep 09 13:03:15.553545 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1891493230-project Sep 09 13:03:15.553545 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:03:15.553545 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance 78dad9a3-ac85-4014-829c-986cca18c8b1 could not be found. Sep 09 13:03:15.553545 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': '78dad9a3-ac85-4014-829c-986cca18c8b1'} Sep 09 13:03:15.554397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:03:15.554397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:15.554397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:03:15.554397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:03:15.554397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:03:15.554397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:03:15.554397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:03:15.554397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:03:15.554397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:03:15.554397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:03:15.554397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78dad9a3-ac85-4014-829c-986cca18c8b1 could not be found. Sep 09 13:03:15.554397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:15.554397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:15.554397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:15.554397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:15.554397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:03:15.554397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:03:15.554397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:03:15.554397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:03:15.554397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:03:15.555693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:03:15.555693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 13:03:15.555693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 13:03:15.555693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 13:03:15.555693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 13:03:15.555693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:03:15.555693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:03:15.555693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:03:15.555693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:03:15.555693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78dad9a3-ac85-4014-829c-986cca18c8b1 could not be found. Sep 09 13:03:15.555693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:15.555693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:15.555693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:15.555693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:15.555693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:03:15.555693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:03:15.555693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:03:15.555693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:03:15.555693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78dad9a3-ac85-4014-829c-986cca18c8b1 could not be found. Sep 09 13:03:15.555693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:03:15.557000 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2f6b09e9-0c23-4891-8d7d-f0fecd2abd8d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Returning 404 to user: Instance 78dad9a3-ac85-4014-829c-986cca18c8b1 could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:03:15.557000 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2f6b09e9-0c23-4891-8d7d-f0fecd2abd8d tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "DELETE /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 404 len: 111 microversion: 2.20 time: 0.031290 Sep 09 13:03:15.557000 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 411/816] 10.222.0.46 () {60 vars in 1280 bytes} [Fri Sep 9 13:03:15 2022] DELETE /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 13:03:15.566145 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a41df1dd-e01c-456e-9c42-d8ef2cfc4c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:15.566958 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a41df1dd-e01c-456e-9c42-d8ef2cfc4c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] [instance: 78dad9a3-ac85-4014-829c-986cca18c8b1] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:15.573406 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a41df1dd-e01c-456e-9c42-d8ef2cfc4c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:15.573972 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a41df1dd-e01c-456e-9c42-d8ef2cfc4c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:15.574472 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a41df1dd-e01c-456e-9c42-d8ef2cfc4c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:15.575787 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a41df1dd-e01c-456e-9c42-d8ef2cfc4c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:15.576312 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a41df1dd-e01c-456e-9c42-d8ef2cfc4c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:15.576799 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a41df1dd-e01c-456e-9c42-d8ef2cfc4c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:15.591317 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-a41df1dd-e01c-456e-9c42-d8ef2cfc4c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] HTTP exception thrown: Instance 78dad9a3-ac85-4014-829c-986cca18c8b1 could not be found. Sep 09 13:03:15.595288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a41df1dd-e01c-456e-9c42-d8ef2cfc4c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Request method failure captured: Sep 09 13:03:15.595288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 HTTP/1.1 Sep 09 13:03:15.595288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 13:03:15.595288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 13:03:15.595288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 13:03:15.595288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 13:03:15.595288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 13:03:15.595288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 13:03:15.595288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 13:03:15.595288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 13:03:15.595288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGzgGc301qUdiFdvHsxfIR2ZHpj_jK1XgnS94H4zqb479BmFK7vk7y9IInkTzPaeassYzBWwIhwUIsIfb8PTxLo46qNMb8y_Xt7zHJgKoPsAssNKlApWDbag0xk_ORmkp1xzj2WRHJwvqOt_bRgXZoss1Uwz6Dfh7FIge5PagJd2rxig Sep 09 13:03:15.595288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 13:03:15.595288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 13:03:15.595288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 13:03:15.595288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 13:03:15.595288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 13:03:15.595288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 13:03:15.595288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 13:03:15.595288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: 8880382269b94daa8a25f92178a478d5 Sep 09 13:03:15.595288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1891493230 Sep 09 13:03:15.595288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 13:03:15.595288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 13:03:15.597236 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8880382269b94daa8a25f92178a478d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8880382269b94daa8a25f92178a478d5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8880382269b94daa8a25f92178a478d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8880382269b94daa8a25f92178a478d5"}]}] Sep 09 13:03:15.597236 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1891493230 Sep 09 13:03:15.597236 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: 8880382269b94daa8a25f92178a478d5 Sep 09 13:03:15.597236 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1891493230 Sep 09 13:03:15.597236 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-AttachVolumeShelveTestJSON-1891493230-project Sep 09 13:03:15.597236 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 13:03:15.597236 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 13:03:15.597236 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: 6ec951604cde4768beb02906caf6d7c2 Sep 09 13:03:15.597236 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1891493230-project Sep 09 13:03:15.597236 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: > Sep 09 13:03:15.597236 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Instance 78dad9a3-ac85-4014-829c-986cca18c8b1 could not be found. Sep 09 13:03:15.597236 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'id': '78dad9a3-ac85-4014-829c-986cca18c8b1'} Sep 09 13:03:15.598790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:03:15.598790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:15.598790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:03:15.598790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:03:15.598790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:03:15.598790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:03:15.598790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:03:15.598790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:03:15.598790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:03:15.598790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:03:15.598790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78dad9a3-ac85-4014-829c-986cca18c8b1 could not be found. Sep 09 13:03:15.598790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:15.598790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:15.598790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:15.598790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:15.598790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:03:15.598790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:03:15.598790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:03:15.598790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:03:15.598790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:03:15.601018 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:03:15.601018 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:03:15.601018 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:03:15.601018 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:03:15.601018 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:03:15.601018 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:03:15.601018 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:03:15.601018 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78dad9a3-ac85-4014-829c-986cca18c8b1 could not be found. Sep 09 13:03:15.601018 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:15.601018 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:03:15.601018 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:15.601018 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:03:15.601018 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:03:15.601018 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:03:15.601018 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:03:15.601018 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:03:15.601018 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78dad9a3-ac85-4014-829c-986cca18c8b1 could not be found. Sep 09 13:03:15.601018 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:03:15.603031 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a41df1dd-e01c-456e-9c42-d8ef2cfc4c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] Returning 404 to user: Instance 78dad9a3-ac85-4014-829c-986cca18c8b1 could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:03:15.603031 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a41df1dd-e01c-456e-9c42-d8ef2cfc4c89 tempest-AttachVolumeShelveTestJSON-1891493230 tempest-AttachVolumeShelveTestJSON-1891493230-project] 10.222.0.46 "GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1" status: 404 len: 111 microversion: 2.20 time: 0.032054 Sep 09 13:03:15.603031 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 406/817] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 13:03:15 2022] GET /compute/v2.1/servers/78dad9a3-ac85-4014-829c-986cca18c8b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 13:03:16.415585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-405df7c7-5131-42fb-a91d-5c1ba6ec2a6b req-dc3c9575-bb05-4651-9b50-d1ccaf342582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10884cc0-9f01-425e-8d5f-9e0727a68b5e", "tag": "b5735773-f9c8-4cb1-80c8-146eef0519fe"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:03:16.428797 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-405df7c7-5131-42fb-a91d-5c1ba6ec2a6b req-dc3c9575-bb05-4651-9b50-d1ccaf342582 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:16.429566 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-405df7c7-5131-42fb-a91d-5c1ba6ec2a6b req-dc3c9575-bb05-4651-9b50-d1ccaf342582 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:16.430155 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-405df7c7-5131-42fb-a91d-5c1ba6ec2a6b req-dc3c9575-bb05-4651-9b50-d1ccaf342582 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:16.444719 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-405df7c7-5131-42fb-a91d-5c1ba6ec2a6b req-dc3c9575-bb05-4651-9b50-d1ccaf342582 service nova] Creating event network-changed:b5735773-f9c8-4cb1-80c8-146eef0519fe for instance 10884cc0-9f01-425e-8d5f-9e0727a68b5e on hv-cinder-81322 Sep 09 13:03:16.454252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-405df7c7-5131-42fb-a91d-5c1ba6ec2a6b req-dc3c9575-bb05-4651-9b50-d1ccaf342582 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042641 Sep 09 13:03:16.458543 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 412/818] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:03:27.315071 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:03:27.315828 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:03:27.448433 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-f9ce2829-938d-4745-a9dc-3d837f820521 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Action: 'create', calling method: .version_select at 0x7f3182f02040>, body: {"keypair": {"name": "tempest-keypair-2037369865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEuOoEoVcMtAIJ7jwJG1w+BZrsXPbIma6HGw7Ip4RnzAchjtuW3PvsiyPsafDade0FOjkNods1XIdFg2Mjqs4z4HqyqpjP9qa3C+ADF6sLVb1dimuBbK++9OY7NC85PDQ=="}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:03:27.465011 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-f9ce2829-938d-4745-a9dc-3d837f820521 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Getting quotas for project 31f8b13a6a4844fc9fd20ab2c3ff7368. Resources: {'key_pairs'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:03:27.469282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-f9ce2829-938d-4745-a9dc-3d837f820521 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Getting quotas for user bc2cc611fd9341fc9a6d8a5d49f43e53 and project 31f8b13a6a4844fc9fd20ab2c3ff7368. Resources: {'key_pairs'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:03:27.571989 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-f9ce2829-938d-4745-a9dc-3d837f820521 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.265051 Sep 09 13:03:27.572520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 407/819] 10.222.0.46 () {60 vars in 1159 bytes} [Fri Sep 9 13:03:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:03:29.940440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=27 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:03:29.941350 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=72 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:03:29.946747 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-c7ab1161-d097-44fc-b45c-d630aad61625 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1300394470", "imageRef": "355bded2-2225-44b2-af86-f9e1861d05ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b64c32cb-4424-44fe-9a55-9c55babbfafd"}], "security_groups": [{"name": "tempest-securitygroup--419651413"}], "key_name": "tempest-keypair-2037369865", "user_data": "}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:03:30.099202 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.network.neutron [None req-c7ab1161-d097-44fc-b45c-d630aad61625 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] validate_networks() for [('b64c32cb-4424-44fe-9a55-9c55babbfafd', None, None, None, None, None)] {{(pid=127771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:03:30.614389 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-c7ab1161-d097-44fc-b45c-d630aad61625 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Flavor limits 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:03:30.614835 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-c7ab1161-d097-44fc-b45c-d630aad61625 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Image limits 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:03:30.615314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-c7ab1161-d097-44fc-b45c-d630aad61625 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Flavor pref 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:03:30.615716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-c7ab1161-d097-44fc-b45c-d630aad61625 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Image pref 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:03:30.616124 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-c7ab1161-d097-44fc-b45c-d630aad61625 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:03:30.625849 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c7ab1161-d097-44fc-b45c-d630aad61625 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:30.626327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c7ab1161-d097-44fc-b45c-d630aad61625 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:30.626789 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c7ab1161-d097-44fc-b45c-d630aad61625 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:30.627539 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c7ab1161-d097-44fc-b45c-d630aad61625 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:30.628256 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c7ab1161-d097-44fc-b45c-d630aad61625 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:30.628675 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c7ab1161-d097-44fc-b45c-d630aad61625 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:30.646814 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-c7ab1161-d097-44fc-b45c-d630aad61625 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Getting quotas for project 31f8b13a6a4844fc9fd20ab2c3ff7368. Resources: {'instances', 'cores', 'ram'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:03:30.650907 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-c7ab1161-d097-44fc-b45c-d630aad61625 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Getting quotas for user bc2cc611fd9341fc9a6d8a5d49f43e53 and project 31f8b13a6a4844fc9fd20ab2c3ff7368. Resources: {'instances', 'cores', 'ram'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:03:30.663032 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-c7ab1161-d097-44fc-b45c-d630aad61625 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Going to run 1 instances... {{(pid=127771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:03:30.665499 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-c7ab1161-d097-44fc-b45c-d630aad61625 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='355bded2-2225-44b2-af86-f9e1861d05ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:03:30.797649 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-c7ab1161-d097-44fc-b45c-d630aad61625 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.859780 Sep 09 13:03:30.798400 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 413/820] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 13:03:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:03:30.811222 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7e19a16e-21d5-4781-b831-fb48c0ced241 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:30.811825 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7e19a16e-21d5-4781-b831-fb48c0ced241 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:30.868903 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7e19a16e-21d5-4781-b831-fb48c0ced241 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:30.878605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7e19a16e-21d5-4781-b831-fb48c0ced241 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1238 microversion: 2.1 time: 0.072640 Sep 09 13:03:30.879078 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 408/821] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:30 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:31.902802 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0bfb2b80-d9ec-4bbd-a58f-62cb8510609d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:31.903412 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-0bfb2b80-d9ec-4bbd-a58f-62cb8510609d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:31.909693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0bfb2b80-d9ec-4bbd-a58f-62cb8510609d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:31.910173 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0bfb2b80-d9ec-4bbd-a58f-62cb8510609d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:31.910640 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0bfb2b80-d9ec-4bbd-a58f-62cb8510609d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:31.911323 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0bfb2b80-d9ec-4bbd-a58f-62cb8510609d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:31.911774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0bfb2b80-d9ec-4bbd-a58f-62cb8510609d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:31.912192 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0bfb2b80-d9ec-4bbd-a58f-62cb8510609d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:31.973920 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-0bfb2b80-d9ec-4bbd-a58f-62cb8510609d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:31.981577 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0bfb2b80-d9ec-4bbd-a58f-62cb8510609d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1242 microversion: 2.1 time: 0.083196 Sep 09 13:03:31.982137 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 414/822] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:31 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:33.005092 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-f5f640be-f3e6-4cd9-a742-412829d3ff61 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:33.005706 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-f5f640be-f3e6-4cd9-a742-412829d3ff61 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:33.012406 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f5f640be-f3e6-4cd9-a742-412829d3ff61 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:33.012898 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f5f640be-f3e6-4cd9-a742-412829d3ff61 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:33.013514 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f5f640be-f3e6-4cd9-a742-412829d3ff61 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:33.014144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f5f640be-f3e6-4cd9-a742-412829d3ff61 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:33.014649 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f5f640be-f3e6-4cd9-a742-412829d3ff61 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:33.015085 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f5f640be-f3e6-4cd9-a742-412829d3ff61 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:33.082730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-f5f640be-f3e6-4cd9-a742-412829d3ff61 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:33.090470 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-f5f640be-f3e6-4cd9-a742-412829d3ff61 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1242 microversion: 2.1 time: 0.089237 Sep 09 13:03:33.091116 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 409/823] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:33 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:34.113840 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-c9016c6c-4610-4704-9392-3548bb1e617e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:34.114453 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-c9016c6c-4610-4704-9392-3548bb1e617e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:34.120969 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c9016c6c-4610-4704-9392-3548bb1e617e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:34.121457 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c9016c6c-4610-4704-9392-3548bb1e617e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:34.121893 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c9016c6c-4610-4704-9392-3548bb1e617e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:34.122614 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c9016c6c-4610-4704-9392-3548bb1e617e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:34.123070 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c9016c6c-4610-4704-9392-3548bb1e617e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:34.123493 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c9016c6c-4610-4704-9392-3548bb1e617e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:34.185229 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-c9016c6c-4610-4704-9392-3548bb1e617e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:34.192809 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-c9016c6c-4610-4704-9392-3548bb1e617e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1290 microversion: 2.1 time: 0.083564 Sep 09 13:03:34.193359 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 415/824] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:34 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1290 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:35.216522 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-5976d714-46bc-49c2-ba96-baa87c68fbcb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:35.218998 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-5976d714-46bc-49c2-ba96-baa87c68fbcb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:35.223974 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5976d714-46bc-49c2-ba96-baa87c68fbcb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:35.224468 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5976d714-46bc-49c2-ba96-baa87c68fbcb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:35.224905 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5976d714-46bc-49c2-ba96-baa87c68fbcb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:35.225610 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5976d714-46bc-49c2-ba96-baa87c68fbcb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:35.226068 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5976d714-46bc-49c2-ba96-baa87c68fbcb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:35.226510 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5976d714-46bc-49c2-ba96-baa87c68fbcb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:35.296202 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-5976d714-46bc-49c2-ba96-baa87c68fbcb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:35.305127 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-5976d714-46bc-49c2-ba96-baa87c68fbcb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1296 microversion: 2.1 time: 0.092343 Sep 09 13:03:35.305721 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 410/825] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:35 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:36.303156 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-8e13ae06-5409-4720-8c6a-14cdfede1231 req-5d8310f6-03fd-473e-8183-917e5341105a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f98258c7-e92a-4ad4-b8c1-9e3c698b48f0", "tag": "29a5dfa1-972f-474a-a210-998d95332748"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:03:36.318384 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-8e13ae06-5409-4720-8c6a-14cdfede1231 req-5d8310f6-03fd-473e-8183-917e5341105a service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:36.319787 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-8e13ae06-5409-4720-8c6a-14cdfede1231 req-5d8310f6-03fd-473e-8183-917e5341105a service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:36.320524 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-8e13ae06-5409-4720-8c6a-14cdfede1231 req-5d8310f6-03fd-473e-8183-917e5341105a service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:36.333452 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-9abfe96f-32c7-4409-aa78-11018a2c2f9a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:36.334960 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-9abfe96f-32c7-4409-aa78-11018a2c2f9a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:36.337219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-8e13ae06-5409-4720-8c6a-14cdfede1231 req-5d8310f6-03fd-473e-8183-917e5341105a service nova] Creating event network-changed:29a5dfa1-972f-474a-a210-998d95332748 for instance f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 on hv-cinder-81322 Sep 09 13:03:36.342769 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-8e13ae06-5409-4720-8c6a-14cdfede1231 req-5d8310f6-03fd-473e-8183-917e5341105a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043491 Sep 09 13:03:36.343239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9abfe96f-32c7-4409-aa78-11018a2c2f9a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:36.346299 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 416/826] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:03:36.346973 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9abfe96f-32c7-4409-aa78-11018a2c2f9a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:36.346973 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9abfe96f-32c7-4409-aa78-11018a2c2f9a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:36.347784 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9abfe96f-32c7-4409-aa78-11018a2c2f9a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:36.348257 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9abfe96f-32c7-4409-aa78-11018a2c2f9a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:36.348695 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9abfe96f-32c7-4409-aa78-11018a2c2f9a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:36.577786 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-9abfe96f-32c7-4409-aa78-11018a2c2f9a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:36.586504 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-9abfe96f-32c7-4409-aa78-11018a2c2f9a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1363 microversion: 2.1 time: 0.258789 Sep 09 13:03:36.590874 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 411/827] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:36 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:37.610265 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-5bf50b1d-7fab-4946-abbf-2cc95f1abd79 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:37.611005 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-5bf50b1d-7fab-4946-abbf-2cc95f1abd79 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:37.617144 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5bf50b1d-7fab-4946-abbf-2cc95f1abd79 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:37.617633 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5bf50b1d-7fab-4946-abbf-2cc95f1abd79 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:37.618075 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5bf50b1d-7fab-4946-abbf-2cc95f1abd79 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:37.618892 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5bf50b1d-7fab-4946-abbf-2cc95f1abd79 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:37.619264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5bf50b1d-7fab-4946-abbf-2cc95f1abd79 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:37.619693 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5bf50b1d-7fab-4946-abbf-2cc95f1abd79 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:37.754048 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-5bf50b1d-7fab-4946-abbf-2cc95f1abd79 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:37.761606 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-5bf50b1d-7fab-4946-abbf-2cc95f1abd79 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1363 microversion: 2.1 time: 0.156116 Sep 09 13:03:37.762155 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 417/828] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:37 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:38.785606 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-020f39df-a204-4219-a197-43b875d1f7d5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:38.786154 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-020f39df-a204-4219-a197-43b875d1f7d5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:38.792725 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-020f39df-a204-4219-a197-43b875d1f7d5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:38.793206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-020f39df-a204-4219-a197-43b875d1f7d5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:38.793639 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-020f39df-a204-4219-a197-43b875d1f7d5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:38.794324 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-020f39df-a204-4219-a197-43b875d1f7d5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:38.794808 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-020f39df-a204-4219-a197-43b875d1f7d5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:38.795238 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-020f39df-a204-4219-a197-43b875d1f7d5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:38.926862 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-020f39df-a204-4219-a197-43b875d1f7d5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:38.934414 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-020f39df-a204-4219-a197-43b875d1f7d5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1363 microversion: 2.1 time: 0.153224 Sep 09 13:03:38.934999 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 412/829] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:38 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:39.959640 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-886d0a31-1131-40ea-b654-14ba77f40238 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:39.960256 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-886d0a31-1131-40ea-b654-14ba77f40238 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:39.967173 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-886d0a31-1131-40ea-b654-14ba77f40238 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:39.967665 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-886d0a31-1131-40ea-b654-14ba77f40238 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:39.968107 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-886d0a31-1131-40ea-b654-14ba77f40238 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:39.968807 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-886d0a31-1131-40ea-b654-14ba77f40238 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:39.969779 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-886d0a31-1131-40ea-b654-14ba77f40238 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:39.970225 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-886d0a31-1131-40ea-b654-14ba77f40238 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:40.112782 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-886d0a31-1131-40ea-b654-14ba77f40238 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:40.122914 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-886d0a31-1131-40ea-b654-14ba77f40238 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1363 microversion: 2.1 time: 0.167558 Sep 09 13:03:40.123661 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 418/830] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:39 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:41.146669 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ff3ba2a2-e538-46bf-bd25-e2457ccd144e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:41.147290 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-ff3ba2a2-e538-46bf-bd25-e2457ccd144e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:41.149613 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=6 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:03:41.154855 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ff3ba2a2-e538-46bf-bd25-e2457ccd144e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:41.155463 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ff3ba2a2-e538-46bf-bd25-e2457ccd144e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:41.155908 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ff3ba2a2-e538-46bf-bd25-e2457ccd144e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:41.156599 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ff3ba2a2-e538-46bf-bd25-e2457ccd144e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:41.157050 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ff3ba2a2-e538-46bf-bd25-e2457ccd144e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:41.157466 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ff3ba2a2-e538-46bf-bd25-e2457ccd144e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:41.292566 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ff3ba2a2-e538-46bf-bd25-e2457ccd144e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:41.300283 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-ff3ba2a2-e538-46bf-bd25-e2457ccd144e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1363 microversion: 2.1 time: 0.157717 Sep 09 13:03:41.302018 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 413/831] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:41 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:42.327332 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-346837cf-8cd4-4037-a00f-b316149b8f99 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:42.328612 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-346837cf-8cd4-4037-a00f-b316149b8f99 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:42.330931 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=2 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:03:42.332333 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=6 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:03:42.337933 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-346837cf-8cd4-4037-a00f-b316149b8f99 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:42.338427 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-346837cf-8cd4-4037-a00f-b316149b8f99 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:42.339049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-346837cf-8cd4-4037-a00f-b316149b8f99 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:42.339700 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-346837cf-8cd4-4037-a00f-b316149b8f99 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:42.340156 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-346837cf-8cd4-4037-a00f-b316149b8f99 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:42.340620 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-346837cf-8cd4-4037-a00f-b316149b8f99 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:42.479728 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-346837cf-8cd4-4037-a00f-b316149b8f99 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:42.488386 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-346837cf-8cd4-4037-a00f-b316149b8f99 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1363 microversion: 2.1 time: 0.164436 Sep 09 13:03:42.499778 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 419/832] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:42 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:43.512562 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a7e75005-d6f5-4ec4-a261-0652f11e9c6f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:43.513171 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a7e75005-d6f5-4ec4-a261-0652f11e9c6f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:43.520410 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a7e75005-d6f5-4ec4-a261-0652f11e9c6f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:43.520890 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a7e75005-d6f5-4ec4-a261-0652f11e9c6f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:43.521319 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a7e75005-d6f5-4ec4-a261-0652f11e9c6f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:43.522002 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a7e75005-d6f5-4ec4-a261-0652f11e9c6f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:43.522459 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a7e75005-d6f5-4ec4-a261-0652f11e9c6f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:43.522900 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a7e75005-d6f5-4ec4-a261-0652f11e9c6f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:43.650959 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a7e75005-d6f5-4ec4-a261-0652f11e9c6f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:43.658674 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a7e75005-d6f5-4ec4-a261-0652f11e9c6f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1363 microversion: 2.1 time: 0.149941 Sep 09 13:03:43.659445 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 414/833] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:43 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:44.682342 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-6c410795-d0e6-4ddc-86f0-637e894230b5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:44.682994 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-6c410795-d0e6-4ddc-86f0-637e894230b5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:44.689383 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6c410795-d0e6-4ddc-86f0-637e894230b5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:44.689869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6c410795-d0e6-4ddc-86f0-637e894230b5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:44.690310 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6c410795-d0e6-4ddc-86f0-637e894230b5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:44.691188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6c410795-d0e6-4ddc-86f0-637e894230b5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:44.691841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6c410795-d0e6-4ddc-86f0-637e894230b5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:44.692276 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6c410795-d0e6-4ddc-86f0-637e894230b5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:44.832758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-6c410795-d0e6-4ddc-86f0-637e894230b5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:44.840467 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-6c410795-d0e6-4ddc-86f0-637e894230b5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1363 microversion: 2.1 time: 0.161949 Sep 09 13:03:44.841033 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 420/834] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:44 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:45.863852 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a8748f52-4d26-4bec-96bd-97ba63186717 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:45.864605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a8748f52-4d26-4bec-96bd-97ba63186717 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:45.871131 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a8748f52-4d26-4bec-96bd-97ba63186717 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:45.871691 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a8748f52-4d26-4bec-96bd-97ba63186717 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:45.872195 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a8748f52-4d26-4bec-96bd-97ba63186717 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:45.872960 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a8748f52-4d26-4bec-96bd-97ba63186717 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:45.873489 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a8748f52-4d26-4bec-96bd-97ba63186717 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:45.873985 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a8748f52-4d26-4bec-96bd-97ba63186717 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:46.007395 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a8748f52-4d26-4bec-96bd-97ba63186717 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:46.015093 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a8748f52-4d26-4bec-96bd-97ba63186717 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1363 microversion: 2.1 time: 0.155584 Sep 09 13:03:46.015976 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 415/835] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:45 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:47.039582 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2a1d32cd-ba81-4f14-b48e-f50bd9131abe tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:47.040205 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2a1d32cd-ba81-4f14-b48e-f50bd9131abe tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:47.046640 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2a1d32cd-ba81-4f14-b48e-f50bd9131abe tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:47.047135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2a1d32cd-ba81-4f14-b48e-f50bd9131abe tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:47.047577 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2a1d32cd-ba81-4f14-b48e-f50bd9131abe tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:47.048268 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2a1d32cd-ba81-4f14-b48e-f50bd9131abe tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:47.048724 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2a1d32cd-ba81-4f14-b48e-f50bd9131abe tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:47.049150 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2a1d32cd-ba81-4f14-b48e-f50bd9131abe tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:47.181596 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2a1d32cd-ba81-4f14-b48e-f50bd9131abe tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:47.189911 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2a1d32cd-ba81-4f14-b48e-f50bd9131abe tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1363 microversion: 2.1 time: 0.155699 Sep 09 13:03:47.201207 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 421/836] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:47 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:47.471834 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-d4f09808-0ae8-4a3c-9bf8-586cea769016 req-7c2a3afb-6674-4f25-8495-5d72306ddde5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98258c7-e92a-4ad4-b8c1-9e3c698b48f0", "name": "network-vif-plugged", "status": "completed", "tag": "29a5dfa1-972f-474a-a210-998d95332748"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:03:47.481974 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-d4f09808-0ae8-4a3c-9bf8-586cea769016 req-7c2a3afb-6674-4f25-8495-5d72306ddde5 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:47.482456 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-d4f09808-0ae8-4a3c-9bf8-586cea769016 req-7c2a3afb-6674-4f25-8495-5d72306ddde5 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:47.482944 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-d4f09808-0ae8-4a3c-9bf8-586cea769016 req-7c2a3afb-6674-4f25-8495-5d72306ddde5 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:47.493701 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-d4f09808-0ae8-4a3c-9bf8-586cea769016 req-7c2a3afb-6674-4f25-8495-5d72306ddde5 service nova] Creating event network-vif-plugged:29a5dfa1-972f-474a-a210-998d95332748 for instance f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 on hv-cinder-81322 Sep 09 13:03:47.498742 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-d4f09808-0ae8-4a3c-9bf8-586cea769016 req-7c2a3afb-6674-4f25-8495-5d72306ddde5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030928 Sep 09 13:03:47.499337 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 416/837] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:03:48.212902 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-1627082b-331e-4929-8749-61766d429257 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:48.213458 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-1627082b-331e-4929-8749-61766d429257 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:48.219546 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1627082b-331e-4929-8749-61766d429257 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:48.224764 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1627082b-331e-4929-8749-61766d429257 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:48.224764 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1627082b-331e-4929-8749-61766d429257 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:48.224764 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1627082b-331e-4929-8749-61766d429257 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:48.224764 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1627082b-331e-4929-8749-61766d429257 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:48.225172 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1627082b-331e-4929-8749-61766d429257 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:48.366946 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-1627082b-331e-4929-8749-61766d429257 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:48.370564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-1627082b-331e-4929-8749-61766d429257 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1363 microversion: 2.1 time: 0.161527 Sep 09 13:03:48.371347 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 422/838] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:48 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:03:49.394528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-88818593-9f34-406d-9148-28947150449b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:49.395139 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-88818593-9f34-406d-9148-28947150449b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:49.401594 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88818593-9f34-406d-9148-28947150449b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:49.402068 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88818593-9f34-406d-9148-28947150449b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:49.402520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88818593-9f34-406d-9148-28947150449b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:49.403204 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88818593-9f34-406d-9148-28947150449b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:49.403652 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88818593-9f34-406d-9148-28947150449b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:49.404071 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88818593-9f34-406d-9148-28947150449b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:49.537229 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-88818593-9f34-406d-9148-28947150449b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:03:49.545041 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-88818593-9f34-406d-9148-28947150449b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1549 microversion: 2.1 time: 0.155420 Sep 09 13:03:49.545597 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 417/839] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:03:49 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:03:49.567686 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-761a331f-b4e2-4905-a734-17091d2e9b7e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:03:49.568834 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-761a331f-b4e2-4905-a734-17091d2e9b7e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:03:49.575617 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-761a331f-b4e2-4905-a734-17091d2e9b7e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:49.576117 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-761a331f-b4e2-4905-a734-17091d2e9b7e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:49.576563 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-761a331f-b4e2-4905-a734-17091d2e9b7e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:49.577267 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-761a331f-b4e2-4905-a734-17091d2e9b7e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:49.577726 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-761a331f-b4e2-4905-a734-17091d2e9b7e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:49.578172 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-761a331f-b4e2-4905-a734-17091d2e9b7e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:49.659202 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-761a331f-b4e2-4905-a734-17091d2e9b7e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095511 Sep 09 13:03:49.659798 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 423/840] 10.222.0.46 () {58 vars in 1275 bytes} [Fri Sep 9 13:03:49 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:03:50.695627 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-d5935c98-2071-46a9-a40c-a68dd4ce68b2 req-3d81f942-0334-407e-86cf-f440855f6cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f98258c7-e92a-4ad4-b8c1-9e3c698b48f0", "tag": "29a5dfa1-972f-474a-a210-998d95332748"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:03:50.710352 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-d5935c98-2071-46a9-a40c-a68dd4ce68b2 req-3d81f942-0334-407e-86cf-f440855f6cd3 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:03:50.711169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-d5935c98-2071-46a9-a40c-a68dd4ce68b2 req-3d81f942-0334-407e-86cf-f440855f6cd3 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:03:50.711737 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-d5935c98-2071-46a9-a40c-a68dd4ce68b2 req-3d81f942-0334-407e-86cf-f440855f6cd3 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:03:50.726188 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-d5935c98-2071-46a9-a40c-a68dd4ce68b2 req-3d81f942-0334-407e-86cf-f440855f6cd3 service nova] Creating event network-changed:29a5dfa1-972f-474a-a210-998d95332748 for instance f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 on hv-cinder-81322 Sep 09 13:03:50.731857 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-d5935c98-2071-46a9-a40c-a68dd4ce68b2 req-3d81f942-0334-407e-86cf-f440855f6cd3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040094 Sep 09 13:03:50.733186 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 418/841] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:04:09.042610 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:04:09.043410 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=56 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:04:09.047352 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-997f2b0a-4211-4482-9502-00d9a2248f1e tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-509770835", "imageRef": "355bded2-2225-44b2-af86-f9e1861d05ff", "flavorRef": "452"}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:04:09.103719 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.network.neutron [None req-997f2b0a-4211-4482-9502-00d9a2248f1e tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] validate_networks() for None {{(pid=127771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:04:09.387956 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-997f2b0a-4211-4482-9502-00d9a2248f1e tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Flavor limits 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:04:09.388394 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-997f2b0a-4211-4482-9502-00d9a2248f1e tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Image limits 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:04:09.391975 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-997f2b0a-4211-4482-9502-00d9a2248f1e tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Flavor pref 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:04:09.391975 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-997f2b0a-4211-4482-9502-00d9a2248f1e tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Image pref 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:04:09.391975 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-997f2b0a-4211-4482-9502-00d9a2248f1e tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:04:09.399973 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-997f2b0a-4211-4482-9502-00d9a2248f1e tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:09.401098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-997f2b0a-4211-4482-9502-00d9a2248f1e tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:09.401547 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-997f2b0a-4211-4482-9502-00d9a2248f1e tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:09.402761 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-997f2b0a-4211-4482-9502-00d9a2248f1e tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:09.403360 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-997f2b0a-4211-4482-9502-00d9a2248f1e tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:09.403808 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-997f2b0a-4211-4482-9502-00d9a2248f1e tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:09.421678 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-997f2b0a-4211-4482-9502-00d9a2248f1e tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Getting quotas for project 6e6cb41b3ee34e6a8418bc61f712e12b. Resources: {'instances', 'cores', 'ram'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:04:09.425749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-997f2b0a-4211-4482-9502-00d9a2248f1e tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Getting quotas for user 8e00b9fe61f3436eac7460ab871e586c and project 6e6cb41b3ee34e6a8418bc61f712e12b. Resources: {'instances', 'cores', 'ram'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:04:09.437433 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-997f2b0a-4211-4482-9502-00d9a2248f1e tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Going to run 1 instances... {{(pid=127771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:04:09.439788 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-997f2b0a-4211-4482-9502-00d9a2248f1e tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] [instance: 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='355bded2-2225-44b2-af86-f9e1861d05ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:04:09.553801 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-997f2b0a-4211-4482-9502-00d9a2248f1e tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512475 Sep 09 13:04:09.554371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 424/842] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 13:04:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:04:09.567116 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-eadd3bf9-96f9-4dff-8abc-f101b047a2c9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:09.569040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-eadd3bf9-96f9-4dff-8abc-f101b047a2c9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] [instance: 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:09.570068 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:04:09.570903 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=52 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:04:09.625066 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-eadd3bf9-96f9-4dff-8abc-f101b047a2c9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e00b9fe61f3436eac7460ab871e586c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6cb41b3ee34e6a8418bc61f712e12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:09.631756 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-eadd3bf9-96f9-4dff-8abc-f101b047a2c9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] 10.222.0.46 "GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9" status: 200 len: 1214 microversion: 2.1 time: 0.069318 Sep 09 13:04:09.632328 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 419/843] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:09 2022] GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:10.655008 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-9e801d5e-3f7b-4247-933c-cb5b5cf0ed27 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:10.655621 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-9e801d5e-3f7b-4247-933c-cb5b5cf0ed27 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] [instance: 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:10.661755 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9e801d5e-3f7b-4247-933c-cb5b5cf0ed27 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:10.662242 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9e801d5e-3f7b-4247-933c-cb5b5cf0ed27 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:10.662708 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9e801d5e-3f7b-4247-933c-cb5b5cf0ed27 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:10.663458 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9e801d5e-3f7b-4247-933c-cb5b5cf0ed27 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:10.663913 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9e801d5e-3f7b-4247-933c-cb5b5cf0ed27 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:10.665007 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9e801d5e-3f7b-4247-933c-cb5b5cf0ed27 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:10.726066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-9e801d5e-3f7b-4247-933c-cb5b5cf0ed27 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e00b9fe61f3436eac7460ab871e586c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6cb41b3ee34e6a8418bc61f712e12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:10.734725 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-9e801d5e-3f7b-4247-933c-cb5b5cf0ed27 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] 10.222.0.46 "GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9" status: 200 len: 1218 microversion: 2.1 time: 0.084503 Sep 09 13:04:10.735290 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 425/844] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:10 2022] GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:04:11.757639 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-53a8ef79-0e15-4755-aa86-3d901dce570f tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:11.759150 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-53a8ef79-0e15-4755-aa86-3d901dce570f tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] [instance: 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:11.766824 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-53a8ef79-0e15-4755-aa86-3d901dce570f tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:11.767430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-53a8ef79-0e15-4755-aa86-3d901dce570f tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:11.768175 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-53a8ef79-0e15-4755-aa86-3d901dce570f tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:11.769138 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-53a8ef79-0e15-4755-aa86-3d901dce570f tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:11.769685 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-53a8ef79-0e15-4755-aa86-3d901dce570f tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:11.770268 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-53a8ef79-0e15-4755-aa86-3d901dce570f tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:11.886823 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-53a8ef79-0e15-4755-aa86-3d901dce570f tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e00b9fe61f3436eac7460ab871e586c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6cb41b3ee34e6a8418bc61f712e12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:11.894976 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-53a8ef79-0e15-4755-aa86-3d901dce570f tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] 10.222.0.46 "GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9" status: 200 len: 1274 microversion: 2.1 time: 0.141757 Sep 09 13:04:11.895551 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 420/845] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:11 2022] GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 => generated 1274 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:12.926607 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-31584597-c27b-42a1-8039-dfd7f1e65bd9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:12.927233 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-31584597-c27b-42a1-8039-dfd7f1e65bd9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] [instance: 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:12.934437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31584597-c27b-42a1-8039-dfd7f1e65bd9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:12.934966 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31584597-c27b-42a1-8039-dfd7f1e65bd9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:12.935410 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31584597-c27b-42a1-8039-dfd7f1e65bd9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:12.936117 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31584597-c27b-42a1-8039-dfd7f1e65bd9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:12.936580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31584597-c27b-42a1-8039-dfd7f1e65bd9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:12.937010 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-31584597-c27b-42a1-8039-dfd7f1e65bd9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:13.076860 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-31584597-c27b-42a1-8039-dfd7f1e65bd9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e00b9fe61f3436eac7460ab871e586c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6cb41b3ee34e6a8418bc61f712e12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:13.085877 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-31584597-c27b-42a1-8039-dfd7f1e65bd9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] 10.222.0.46 "GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9" status: 200 len: 1314 microversion: 2.1 time: 0.163224 Sep 09 13:04:13.101389 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 426/846] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:12 2022] GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:13.720070 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-3634f883-be67-40ca-9dea-9867c858d9d3 req-df366182-f850-453a-874b-921f254db6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bef46fa-58ec-4e7f-b601-a84ce2e7dff9", "tag": "b495c76f-6454-4bb3-9e7e-e1e3c45f3468"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:04:13.730421 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-3634f883-be67-40ca-9dea-9867c858d9d3 req-df366182-f850-453a-874b-921f254db6f5 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:13.730950 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-3634f883-be67-40ca-9dea-9867c858d9d3 req-df366182-f850-453a-874b-921f254db6f5 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:13.731385 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-3634f883-be67-40ca-9dea-9867c858d9d3 req-df366182-f850-453a-874b-921f254db6f5 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:13.742255 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-3634f883-be67-40ca-9dea-9867c858d9d3 req-df366182-f850-453a-874b-921f254db6f5 service nova] Creating event network-changed:b495c76f-6454-4bb3-9e7e-e1e3c45f3468 for instance 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 on hv-cinder-81322 Sep 09 13:04:13.748252 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-3634f883-be67-40ca-9dea-9867c858d9d3 req-df366182-f850-453a-874b-921f254db6f5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032902 Sep 09 13:04:13.748996 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 421/847] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:04:14.113103 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-b0ff5152-3b00-4019-bd69-91fe340f2f39 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:14.113813 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-b0ff5152-3b00-4019-bd69-91fe340f2f39 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] [instance: 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:14.125572 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b0ff5152-3b00-4019-bd69-91fe340f2f39 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:14.126368 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b0ff5152-3b00-4019-bd69-91fe340f2f39 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:14.127064 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b0ff5152-3b00-4019-bd69-91fe340f2f39 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:14.129089 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b0ff5152-3b00-4019-bd69-91fe340f2f39 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:14.129632 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b0ff5152-3b00-4019-bd69-91fe340f2f39 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:14.130131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b0ff5152-3b00-4019-bd69-91fe340f2f39 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:14.272073 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-b0ff5152-3b00-4019-bd69-91fe340f2f39 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e00b9fe61f3436eac7460ab871e586c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6cb41b3ee34e6a8418bc61f712e12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:14.280279 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-b0ff5152-3b00-4019-bd69-91fe340f2f39 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] 10.222.0.46 "GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9" status: 200 len: 1314 microversion: 2.1 time: 0.171254 Sep 09 13:04:14.280860 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 427/848] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:14 2022] GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:15.303516 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-639d9a40-fc34-4bf0-94bb-17da2a13cf39 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:15.304258 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-639d9a40-fc34-4bf0-94bb-17da2a13cf39 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] [instance: 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:15.311545 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-639d9a40-fc34-4bf0-94bb-17da2a13cf39 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:15.312031 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-639d9a40-fc34-4bf0-94bb-17da2a13cf39 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:15.312472 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-639d9a40-fc34-4bf0-94bb-17da2a13cf39 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:15.313169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-639d9a40-fc34-4bf0-94bb-17da2a13cf39 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:15.313630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-639d9a40-fc34-4bf0-94bb-17da2a13cf39 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:15.314056 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-639d9a40-fc34-4bf0-94bb-17da2a13cf39 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:15.450417 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-639d9a40-fc34-4bf0-94bb-17da2a13cf39 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e00b9fe61f3436eac7460ab871e586c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6cb41b3ee34e6a8418bc61f712e12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:15.460208 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-639d9a40-fc34-4bf0-94bb-17da2a13cf39 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] 10.222.0.46 "GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9" status: 200 len: 1314 microversion: 2.1 time: 0.160633 Sep 09 13:04:15.460775 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 422/849] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:15 2022] GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:16.484123 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-428b47b8-8850-4b1c-892e-40001658adff tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:16.484782 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-428b47b8-8850-4b1c-892e-40001658adff tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] [instance: 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:16.491656 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-428b47b8-8850-4b1c-892e-40001658adff tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:16.492167 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-428b47b8-8850-4b1c-892e-40001658adff tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:16.492604 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-428b47b8-8850-4b1c-892e-40001658adff tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:16.493308 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-428b47b8-8850-4b1c-892e-40001658adff tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:16.493759 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-428b47b8-8850-4b1c-892e-40001658adff tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:16.494180 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-428b47b8-8850-4b1c-892e-40001658adff tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:16.631504 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-428b47b8-8850-4b1c-892e-40001658adff tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e00b9fe61f3436eac7460ab871e586c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6cb41b3ee34e6a8418bc61f712e12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:16.639761 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-428b47b8-8850-4b1c-892e-40001658adff tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] 10.222.0.46 "GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9" status: 200 len: 1314 microversion: 2.1 time: 0.159605 Sep 09 13:04:16.640416 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 428/850] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:16 2022] GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:17.662773 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-13f0826c-d8cf-4129-8979-ecad34a3e569 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:17.663381 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-13f0826c-d8cf-4129-8979-ecad34a3e569 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] [instance: 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:17.670286 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-13f0826c-d8cf-4129-8979-ecad34a3e569 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:17.670798 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-13f0826c-d8cf-4129-8979-ecad34a3e569 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:17.671231 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-13f0826c-d8cf-4129-8979-ecad34a3e569 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:17.671912 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-13f0826c-d8cf-4129-8979-ecad34a3e569 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:17.672362 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-13f0826c-d8cf-4129-8979-ecad34a3e569 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:17.672782 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-13f0826c-d8cf-4129-8979-ecad34a3e569 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:17.807485 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-13f0826c-d8cf-4129-8979-ecad34a3e569 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e00b9fe61f3436eac7460ab871e586c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6cb41b3ee34e6a8418bc61f712e12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:17.815087 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-13f0826c-d8cf-4129-8979-ecad34a3e569 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] 10.222.0.46 "GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9" status: 200 len: 1314 microversion: 2.1 time: 0.156219 Sep 09 13:04:17.815645 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 423/851] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:17 2022] GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:18.839044 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ece94ddc-16e6-4252-8658-86e37264b8c9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:18.839730 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ece94ddc-16e6-4252-8658-86e37264b8c9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] [instance: 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:18.845496 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ece94ddc-16e6-4252-8658-86e37264b8c9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:18.845974 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ece94ddc-16e6-4252-8658-86e37264b8c9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:18.846406 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ece94ddc-16e6-4252-8658-86e37264b8c9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:18.847111 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ece94ddc-16e6-4252-8658-86e37264b8c9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:18.847560 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ece94ddc-16e6-4252-8658-86e37264b8c9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:18.847979 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ece94ddc-16e6-4252-8658-86e37264b8c9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:18.974244 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ece94ddc-16e6-4252-8658-86e37264b8c9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e00b9fe61f3436eac7460ab871e586c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6cb41b3ee34e6a8418bc61f712e12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:18.982392 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ece94ddc-16e6-4252-8658-86e37264b8c9 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] 10.222.0.46 "GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9" status: 200 len: 1314 microversion: 2.1 time: 0.148098 Sep 09 13:04:18.982977 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 429/852] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:18 2022] GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:19.578320 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-52e0113b-657b-4ea9-94ff-f6a285414629 req-bad726ce-cf3d-4454-ab5a-2c87af71e4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bef46fa-58ec-4e7f-b601-a84ce2e7dff9", "name": "network-vif-plugged", "status": "completed", "tag": "b495c76f-6454-4bb3-9e7e-e1e3c45f3468"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:04:19.588337 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-52e0113b-657b-4ea9-94ff-f6a285414629 req-bad726ce-cf3d-4454-ab5a-2c87af71e4f0 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:19.588827 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-52e0113b-657b-4ea9-94ff-f6a285414629 req-bad726ce-cf3d-4454-ab5a-2c87af71e4f0 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:19.589295 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-52e0113b-657b-4ea9-94ff-f6a285414629 req-bad726ce-cf3d-4454-ab5a-2c87af71e4f0 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:19.600033 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-52e0113b-657b-4ea9-94ff-f6a285414629 req-bad726ce-cf3d-4454-ab5a-2c87af71e4f0 service nova] Creating event network-vif-plugged:b495c76f-6454-4bb3-9e7e-e1e3c45f3468 for instance 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 on hv-cinder-81322 Sep 09 13:04:19.605851 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-52e0113b-657b-4ea9-94ff-f6a285414629 req-bad726ce-cf3d-4454-ab5a-2c87af71e4f0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031304 Sep 09 13:04:19.606474 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 424/853] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:04:20.005124 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e7fce414-4a88-4cc0-a710-28cf85810c48 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:20.005748 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-e7fce414-4a88-4cc0-a710-28cf85810c48 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] [instance: 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:20.007634 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=2 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:04:20.008415 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=6 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:04:20.014105 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e7fce414-4a88-4cc0-a710-28cf85810c48 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:20.014637 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e7fce414-4a88-4cc0-a710-28cf85810c48 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:20.015087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e7fce414-4a88-4cc0-a710-28cf85810c48 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:20.015788 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e7fce414-4a88-4cc0-a710-28cf85810c48 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:20.016304 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e7fce414-4a88-4cc0-a710-28cf85810c48 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:20.016681 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e7fce414-4a88-4cc0-a710-28cf85810c48 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:20.151871 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e7fce414-4a88-4cc0-a710-28cf85810c48 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e00b9fe61f3436eac7460ab871e586c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6cb41b3ee34e6a8418bc61f712e12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:20.159540 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-e7fce414-4a88-4cc0-a710-28cf85810c48 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] 10.222.0.46 "GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9" status: 200 len: 1314 microversion: 2.1 time: 0.158261 Sep 09 13:04:20.160108 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 430/854] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:20 2022] GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:21.183644 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c7b828cd-2356-4173-8ce4-967d6a5411be tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:21.184119 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-c7b828cd-2356-4173-8ce4-967d6a5411be tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] [instance: 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:21.185799 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=2 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:04:21.191683 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c7b828cd-2356-4173-8ce4-967d6a5411be tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:21.192133 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c7b828cd-2356-4173-8ce4-967d6a5411be tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:21.192434 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c7b828cd-2356-4173-8ce4-967d6a5411be tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:21.193116 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c7b828cd-2356-4173-8ce4-967d6a5411be tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:21.193572 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c7b828cd-2356-4173-8ce4-967d6a5411be tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:21.194010 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c7b828cd-2356-4173-8ce4-967d6a5411be tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:21.333049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c7b828cd-2356-4173-8ce4-967d6a5411be tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e00b9fe61f3436eac7460ab871e586c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6cb41b3ee34e6a8418bc61f712e12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:21.342051 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-c7b828cd-2356-4173-8ce4-967d6a5411be tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] 10.222.0.46 "GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9" status: 200 len: 1314 microversion: 2.1 time: 0.163947 Sep 09 13:04:21.342689 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 425/855] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:21 2022] GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:22.365684 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e277a522-422b-438d-af4a-4dfef3727b40 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:22.366224 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-e277a522-422b-438d-af4a-4dfef3727b40 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] [instance: 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:22.373291 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e277a522-422b-438d-af4a-4dfef3727b40 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:22.373777 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e277a522-422b-438d-af4a-4dfef3727b40 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:22.374219 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e277a522-422b-438d-af4a-4dfef3727b40 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:22.374975 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e277a522-422b-438d-af4a-4dfef3727b40 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:22.375432 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e277a522-422b-438d-af4a-4dfef3727b40 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:22.375858 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e277a522-422b-438d-af4a-4dfef3727b40 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:22.503286 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e277a522-422b-438d-af4a-4dfef3727b40 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e00b9fe61f3436eac7460ab871e586c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6cb41b3ee34e6a8418bc61f712e12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:22.511561 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-e277a522-422b-438d-af4a-4dfef3727b40 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] 10.222.0.46 "GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9" status: 200 len: 1464 microversion: 2.1 time: 0.149796 Sep 09 13:04:22.512124 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 431/856] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:22 2022] GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:22.556773 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a8d65c5c-064d-49f0-bddf-c10289c25604 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:22.557912 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a8d65c5c-064d-49f0-bddf-c10289c25604 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] [instance: 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:22.564343 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a8d65c5c-064d-49f0-bddf-c10289c25604 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:22.564820 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a8d65c5c-064d-49f0-bddf-c10289c25604 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:22.565250 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a8d65c5c-064d-49f0-bddf-c10289c25604 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:22.565930 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a8d65c5c-064d-49f0-bddf-c10289c25604 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:22.566379 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a8d65c5c-064d-49f0-bddf-c10289c25604 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:22.566832 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a8d65c5c-064d-49f0-bddf-c10289c25604 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:22.594736 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a8d65c5c-064d-49f0-bddf-c10289c25604 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] [instance: 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9] Going to try to terminate instance {{(pid=127772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:04:22.900407 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a8d65c5c-064d-49f0-bddf-c10289c25604 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9" status: 204 len: 0 microversion: 2.1 time: 0.347092 Sep 09 13:04:22.901541 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 426/857] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:04:22 2022] DELETE /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:04:22.909770 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-afdea829-fc64-47f5-9582-10c525796bd3 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:22.910395 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-afdea829-fc64-47f5-9582-10c525796bd3 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] [instance: 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:22.917314 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-afdea829-fc64-47f5-9582-10c525796bd3 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:22.920042 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-afdea829-fc64-47f5-9582-10c525796bd3 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:22.920042 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-afdea829-fc64-47f5-9582-10c525796bd3 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:22.920042 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-afdea829-fc64-47f5-9582-10c525796bd3 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:22.920042 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-afdea829-fc64-47f5-9582-10c525796bd3 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:22.920422 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-afdea829-fc64-47f5-9582-10c525796bd3 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:23.049346 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-afdea829-fc64-47f5-9582-10c525796bd3 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e00b9fe61f3436eac7460ab871e586c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6cb41b3ee34e6a8418bc61f712e12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:23.057135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-afdea829-fc64-47f5-9582-10c525796bd3 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] 10.222.0.46 "GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9" status: 200 len: 1470 microversion: 2.1 time: 0.151261 Sep 09 13:04:23.057730 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 432/858] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:22 2022] GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:24.080504 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-6d5e512d-91f5-44ae-ba59-acbee7eba9bc tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:24.081202 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-6d5e512d-91f5-44ae-ba59-acbee7eba9bc tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] [instance: 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:24.087771 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6d5e512d-91f5-44ae-ba59-acbee7eba9bc tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:24.088716 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6d5e512d-91f5-44ae-ba59-acbee7eba9bc tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:24.089175 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6d5e512d-91f5-44ae-ba59-acbee7eba9bc tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:24.089866 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6d5e512d-91f5-44ae-ba59-acbee7eba9bc tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:24.090322 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6d5e512d-91f5-44ae-ba59-acbee7eba9bc tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:24.090771 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6d5e512d-91f5-44ae-ba59-acbee7eba9bc tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:24.223966 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-6d5e512d-91f5-44ae-ba59-acbee7eba9bc tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e00b9fe61f3436eac7460ab871e586c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6cb41b3ee34e6a8418bc61f712e12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:24.233115 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-6d5e512d-91f5-44ae-ba59-acbee7eba9bc tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] 10.222.0.46 "GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9" status: 200 len: 1470 microversion: 2.1 time: 0.156855 Sep 09 13:04:24.233694 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 427/859] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:24 2022] GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:25.256222 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d7907099-6b74-4a90-8132-2051a0be9e48 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:25.266392 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-d7907099-6b74-4a90-8132-2051a0be9e48 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] [instance: 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:25.266392 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d7907099-6b74-4a90-8132-2051a0be9e48 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:25.266392 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d7907099-6b74-4a90-8132-2051a0be9e48 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:25.266392 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d7907099-6b74-4a90-8132-2051a0be9e48 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:25.266989 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d7907099-6b74-4a90-8132-2051a0be9e48 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:25.266989 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d7907099-6b74-4a90-8132-2051a0be9e48 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:25.266989 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d7907099-6b74-4a90-8132-2051a0be9e48 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:25.398334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-d7907099-6b74-4a90-8132-2051a0be9e48 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e00b9fe61f3436eac7460ab871e586c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6cb41b3ee34e6a8418bc61f712e12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:25.406946 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d7907099-6b74-4a90-8132-2051a0be9e48 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] 10.222.0.46 "GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9" status: 200 len: 1470 microversion: 2.1 time: 0.154669 Sep 09 13:04:25.407519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 433/860] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:25 2022] GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:25.976407 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-431979da-9c1e-484f-81cf-c5489d166626 req-3bda24b3-0e16-4290-a9b3-5f0a59e6112d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bef46fa-58ec-4e7f-b601-a84ce2e7dff9", "name": "network-vif-deleted", "tag": "b495c76f-6454-4bb3-9e7e-e1e3c45f3468"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:04:25.987095 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-431979da-9c1e-484f-81cf-c5489d166626 req-3bda24b3-0e16-4290-a9b3-5f0a59e6112d service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:25.990699 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-431979da-9c1e-484f-81cf-c5489d166626 req-3bda24b3-0e16-4290-a9b3-5f0a59e6112d service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:25.990699 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-431979da-9c1e-484f-81cf-c5489d166626 req-3bda24b3-0e16-4290-a9b3-5f0a59e6112d service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:26.000303 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-431979da-9c1e-484f-81cf-c5489d166626 req-3bda24b3-0e16-4290-a9b3-5f0a59e6112d service nova] Creating event network-vif-deleted:b495c76f-6454-4bb3-9e7e-e1e3c45f3468 for instance 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 on hv-cinder-81322 Sep 09 13:04:26.005147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-431979da-9c1e-484f-81cf-c5489d166626 req-3bda24b3-0e16-4290-a9b3-5f0a59e6112d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032636 Sep 09 13:04:26.005748 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 428/861] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:04:26.430963 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-bb4e8775-e2a1-484f-936f-30908aca4891 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:26.431580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-bb4e8775-e2a1-484f-936f-30908aca4891 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] [instance: 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:26.438501 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bb4e8775-e2a1-484f-936f-30908aca4891 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:26.439005 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bb4e8775-e2a1-484f-936f-30908aca4891 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:26.439643 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bb4e8775-e2a1-484f-936f-30908aca4891 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:26.440352 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bb4e8775-e2a1-484f-936f-30908aca4891 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:26.440858 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bb4e8775-e2a1-484f-936f-30908aca4891 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:26.441286 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bb4e8775-e2a1-484f-936f-30908aca4891 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:26.473434 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bb4e8775-e2a1-484f-936f-30908aca4891 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:26.473923 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bb4e8775-e2a1-484f-936f-30908aca4891 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:26.474360 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-bb4e8775-e2a1-484f-936f-30908aca4891 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:26.474829 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.objects.instance [None req-bb4e8775-e2a1-484f-936f-30908aca4891 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lazy-loading 'fault' on Instance uuid 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 {{(pid=127771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:04:26.517780 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-bb4e8775-e2a1-484f-936f-30908aca4891 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e00b9fe61f3436eac7460ab871e586c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6cb41b3ee34e6a8418bc61f712e12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:26.525724 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-bb4e8775-e2a1-484f-936f-30908aca4891 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] 10.222.0.46 "GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9" status: 200 len: 1304 microversion: 2.1 time: 0.098742 Sep 09 13:04:26.526852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 434/862] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:26 2022] GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:26.645295 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-2abe8049-360e-478a-aa5a-b35ea37a5228 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:26.645810 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-2abe8049-360e-478a-aa5a-b35ea37a5228 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:26.653095 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2abe8049-360e-478a-aa5a-b35ea37a5228 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:26.653831 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2abe8049-360e-478a-aa5a-b35ea37a5228 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:26.654386 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2abe8049-360e-478a-aa5a-b35ea37a5228 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:26.655108 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2abe8049-360e-478a-aa5a-b35ea37a5228 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:26.655563 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2abe8049-360e-478a-aa5a-b35ea37a5228 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:26.655996 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2abe8049-360e-478a-aa5a-b35ea37a5228 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:26.679398 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-2abe8049-360e-478a-aa5a-b35ea37a5228 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0/ips" status: 200 len: 146 microversion: 2.1 time: 0.038545 Sep 09 13:04:26.679965 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 429/863] 10.222.0.46 () {58 vars in 1248 bytes} [Fri Sep 9 13:04:26 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:04:27.548943 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0a8743a6-b7bb-48b0-a0c6-811e699f0383 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:27.549489 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-0a8743a6-b7bb-48b0-a0c6-811e699f0383 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] [instance: 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:27.555851 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0a8743a6-b7bb-48b0-a0c6-811e699f0383 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:27.556335 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0a8743a6-b7bb-48b0-a0c6-811e699f0383 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:27.556775 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0a8743a6-b7bb-48b0-a0c6-811e699f0383 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:27.558128 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0a8743a6-b7bb-48b0-a0c6-811e699f0383 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:27.558612 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0a8743a6-b7bb-48b0-a0c6-811e699f0383 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:27.559043 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0a8743a6-b7bb-48b0-a0c6-811e699f0383 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:27.572076 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-0a8743a6-b7bb-48b0-a0c6-811e699f0383 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] HTTP exception thrown: Instance 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 could not be found. Sep 09 13:04:27.573716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0a8743a6-b7bb-48b0-a0c6-811e699f0383 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Request method failure captured: Sep 09 13:04:27.573716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 HTTP/1.1 Sep 09 13:04:27.573716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:04:27.573716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:04:27.573716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:04:27.573716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:04:27.573716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:04:27.573716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:04:27.573716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:04:27.573716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:04:27.573716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGznHnLG59Wi4PYH-WZFDwJVL5Ps_s31PLH3PBJHqu5ZDna7mKEL6oIgZqpuxD2bJF4kVGqp995QYmm0_ZT_0PwwXY16-8OnOrUNjtgkfqOX359OdHSZ9fA0mHelfuPEm_OTSVwFyiKyv07B_xctxP5TwBHW7a8L4-WHM-12FpmZkmN0 Sep 09 13:04:27.573716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:04:27.573716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:04:27.573716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:04:27.573716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:04:27.573716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:04:27.573716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:04:27.573716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: 6e6cb41b3ee34e6a8418bc61f712e12b Sep 09 13:04:27.573716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-VolumesNegativeTest-293788736 Sep 09 13:04:27.573716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:04:27.573716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:04:27.575496 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6e6cb41b3ee34e6a8418bc61f712e12b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6e6cb41b3ee34e6a8418bc61f712e12b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6e6cb41b3ee34e6a8418bc61f712e12b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6e6cb41b3ee34e6a8418bc61f712e12b"}]}] Sep 09 13:04:27.575496 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-VolumesNegativeTest-293788736 Sep 09 13:04:27.575496 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: 6e6cb41b3ee34e6a8418bc61f712e12b Sep 09 13:04:27.575496 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-VolumesNegativeTest-293788736 Sep 09 13:04:27.575496 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-VolumesNegativeTest-293788736-project Sep 09 13:04:27.575496 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:04:27.575496 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:04:27.575496 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 8e00b9fe61f3436eac7460ab871e586c Sep 09 13:04:27.575496 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-VolumesNegativeTest-293788736-project Sep 09 13:04:27.575496 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:04:27.575496 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 could not be found. Sep 09 13:04:27.575496 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': '3bef46fa-58ec-4e7f-b601-a84ce2e7dff9'} Sep 09 13:04:27.576425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:04:27.576425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:04:27.576425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:04:27.576425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:04:27.576425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:04:27.576425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:04:27.576425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:04:27.576425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:04:27.576425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:04:27.576425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:04:27.576425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 could not be found. Sep 09 13:04:27.576425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:04:27.576425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:04:27.576425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:04:27.576425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:04:27.576425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:04:27.576425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:04:27.576425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:04:27.576425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:04:27.576425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:04:27.577964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:04:27.577964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:04:27.577964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:04:27.577964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:04:27.577964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:04:27.577964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:04:27.577964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:04:27.577964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 could not be found. Sep 09 13:04:27.577964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:04:27.577964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:04:27.577964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:04:27.577964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:04:27.577964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:04:27.577964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:04:27.577964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:04:27.577964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:04:27.577964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 could not be found. Sep 09 13:04:27.577964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:04:27.579406 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0a8743a6-b7bb-48b0-a0c6-811e699f0383 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] Returning 404 to user: Instance 3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:04:27.579406 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0a8743a6-b7bb-48b0-a0c6-811e699f0383 tempest-VolumesNegativeTest-293788736 tempest-VolumesNegativeTest-293788736-project] 10.222.0.46 "GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9" status: 404 len: 111 microversion: 2.1 time: 0.030142 Sep 09 13:04:27.579406 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 435/864] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:27 2022] GET /compute/v2.1/servers/3bef46fa-58ec-4e7f-b601-a84ce2e7dff9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:04:29.215924 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-0d1a060b-0f1c-478a-b48a-fd631e1a6913 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1858650600", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1884139847", "security_groups": [{"name": "tempest-secgroup-smoke-2064900932"}], "block_device_mapping_v2": [{"uuid": "4fe69dd4-695c-43d1-8e81-adc40bd48948", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bc9bf6c8-7de3-464c-a549-1b7488b07c6e"}]}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:04:29.568257 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.network.neutron [None req-0d1a060b-0f1c-478a-b48a-fd631e1a6913 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] validate_networks() for [('bc9bf6c8-7de3-464c-a549-1b7488b07c6e', None, None, None, None, None)] {{(pid=127772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:04:29.714359 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-739ed690-a3a3-4913-be01-dd32e15555bf tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6bcc61d-049e-4934-acfd-0a4352b2d1d8"}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:04:29.719865 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-739ed690-a3a3-4913-be01-dd32e15555bf tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:29.727730 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-739ed690-a3a3-4913-be01-dd32e15555bf tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:29.728454 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-739ed690-a3a3-4913-be01-dd32e15555bf tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:29.728897 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-739ed690-a3a3-4913-be01-dd32e15555bf tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:29.730197 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-739ed690-a3a3-4913-be01-dd32e15555bf tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:29.730692 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-739ed690-a3a3-4913-be01-dd32e15555bf tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:29.731123 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-739ed690-a3a3-4913-be01-dd32e15555bf tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:29.978835 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-0d1a060b-0f1c-478a-b48a-fd631e1a6913 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Flavor limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:04:29.979873 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-0d1a060b-0f1c-478a-b48a-fd631e1a6913 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Image limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:04:29.980433 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-0d1a060b-0f1c-478a-b48a-fd631e1a6913 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Flavor pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:04:29.980905 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-0d1a060b-0f1c-478a-b48a-fd631e1a6913 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Image pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:04:29.981321 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-0d1a060b-0f1c-478a-b48a-fd631e1a6913 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:04:29.991131 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0d1a060b-0f1c-478a-b48a-fd631e1a6913 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:29.996732 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0d1a060b-0f1c-478a-b48a-fd631e1a6913 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:29.996732 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0d1a060b-0f1c-478a-b48a-fd631e1a6913 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:29.996732 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0d1a060b-0f1c-478a-b48a-fd631e1a6913 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:29.996732 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0d1a060b-0f1c-478a-b48a-fd631e1a6913 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:29.997079 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0d1a060b-0f1c-478a-b48a-fd631e1a6913 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:30.022811 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-0d1a060b-0f1c-478a-b48a-fd631e1a6913 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Getting quotas for project d427be7da6084e009b87ff500858cdc8. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:04:30.030214 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-0d1a060b-0f1c-478a-b48a-fd631e1a6913 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Getting quotas for user 4c96322c48c146c7b8bcb9959f533820 and project d427be7da6084e009b87ff500858cdc8. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:04:30.117424 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-0d1a060b-0f1c-478a-b48a-fd631e1a6913 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Going to run 1 instances... {{(pid=127772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:04:30.121825 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-0d1a060b-0f1c-478a-b48a-fd631e1a6913 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4fe69dd4-695c-43d1-8e81-adc40bd48948',volume_size=None,volume_type=None)] {{(pid=127772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:04:30.441544 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-739ed690-a3a3-4913-be01-dd32e15555bf tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "POST /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.731023 Sep 09 13:04:30.459190 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 436/865] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 13:04:29 2022] POST /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0/os-volume_attachments => generated 194 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:04:30.624436 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-0d1a060b-0f1c-478a-b48a-fd631e1a6913 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.413004 Sep 09 13:04:30.629394 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 430/866] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 13:04:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 1419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:04:30.643370 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-85d0378e-4fad-4968-9ccb-aaceb1d89abf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:30.644098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-85d0378e-4fad-4968-9ccb-aaceb1d89abf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:30.973730 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-85d0378e-4fad-4968-9ccb-aaceb1d89abf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:30.981425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-85d0378e-4fad-4968-9ccb-aaceb1d89abf tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1095 microversion: 2.1 time: 0.342634 Sep 09 13:04:30.981986 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 437/867] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:30 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1095 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:32.004605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-be6287d0-b6cf-46b8-8c0e-7c1fd58133fa tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:32.005373 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-be6287d0-b6cf-46b8-8c0e-7c1fd58133fa tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:32.013318 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-be6287d0-b6cf-46b8-8c0e-7c1fd58133fa tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:32.013833 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-be6287d0-b6cf-46b8-8c0e-7c1fd58133fa tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:32.014267 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-be6287d0-b6cf-46b8-8c0e-7c1fd58133fa tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:32.015203 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-be6287d0-b6cf-46b8-8c0e-7c1fd58133fa tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:32.015567 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-be6287d0-b6cf-46b8-8c0e-7c1fd58133fa tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:32.016289 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-be6287d0-b6cf-46b8-8c0e-7c1fd58133fa tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:32.083514 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-be6287d0-b6cf-46b8-8c0e-7c1fd58133fa tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:32.090653 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-be6287d0-b6cf-46b8-8c0e-7c1fd58133fa tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1137 microversion: 2.1 time: 0.091394 Sep 09 13:04:32.091223 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 431/868] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:31 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1137 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:33.114099 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-15067e09-1d88-493f-9e42-6eb3baeacb5a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:33.114758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-15067e09-1d88-493f-9e42-6eb3baeacb5a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:33.123591 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-15067e09-1d88-493f-9e42-6eb3baeacb5a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:33.124340 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-15067e09-1d88-493f-9e42-6eb3baeacb5a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:33.124783 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-15067e09-1d88-493f-9e42-6eb3baeacb5a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:33.125494 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-15067e09-1d88-493f-9e42-6eb3baeacb5a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:33.126170 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-15067e09-1d88-493f-9e42-6eb3baeacb5a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:33.126404 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-15067e09-1d88-493f-9e42-6eb3baeacb5a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:33.188240 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-15067e09-1d88-493f-9e42-6eb3baeacb5a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:33.196221 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-15067e09-1d88-493f-9e42-6eb3baeacb5a tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1211 microversion: 2.1 time: 0.086129 Sep 09 13:04:33.196918 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 438/869] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:33 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:34.222677 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-d68fc8ac-b795-45e6-b572-d81b3b534679 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:34.223328 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-d68fc8ac-b795-45e6-b572-d81b3b534679 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:34.230867 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d68fc8ac-b795-45e6-b572-d81b3b534679 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:34.231364 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d68fc8ac-b795-45e6-b572-d81b3b534679 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:34.231805 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d68fc8ac-b795-45e6-b572-d81b3b534679 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:34.232519 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d68fc8ac-b795-45e6-b572-d81b3b534679 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:34.232975 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d68fc8ac-b795-45e6-b572-d81b3b534679 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:34.233401 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d68fc8ac-b795-45e6-b572-d81b3b534679 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:34.441786 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-d68fc8ac-b795-45e6-b572-d81b3b534679 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:34.450147 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-d68fc8ac-b795-45e6-b572-d81b3b534679 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1279 microversion: 2.1 time: 0.231679 Sep 09 13:04:34.450750 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 432/870] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:34 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1279 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:34.621129 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-0ff235f3-570a-42bb-9eb4-3ae50bd5db3c req-e0dd0201-6055-45dc-8caf-d26ea10a9aad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0325a8c5-db4f-4392-aa58-fc53eb462135", "tag": "3222ab4b-e295-4bda-9942-ac4365118d85"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:04:34.634374 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-0ff235f3-570a-42bb-9eb4-3ae50bd5db3c req-e0dd0201-6055-45dc-8caf-d26ea10a9aad service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:34.635098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-0ff235f3-570a-42bb-9eb4-3ae50bd5db3c req-e0dd0201-6055-45dc-8caf-d26ea10a9aad service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:34.636306 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-0ff235f3-570a-42bb-9eb4-3ae50bd5db3c req-e0dd0201-6055-45dc-8caf-d26ea10a9aad service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:34.648486 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-0ff235f3-570a-42bb-9eb4-3ae50bd5db3c req-e0dd0201-6055-45dc-8caf-d26ea10a9aad service nova] Creating event network-changed:3222ab4b-e295-4bda-9942-ac4365118d85 for instance 0325a8c5-db4f-4392-aa58-fc53eb462135 on hv-cinder-81322 Sep 09 13:04:34.654876 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-0ff235f3-570a-42bb-9eb4-3ae50bd5db3c req-e0dd0201-6055-45dc-8caf-d26ea10a9aad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038481 Sep 09 13:04:34.655738 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 439/871] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:04:35.473333 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-58ca6eca-97f6-4f0f-ac2e-676ba0921261 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:35.473928 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-58ca6eca-97f6-4f0f-ac2e-676ba0921261 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:35.487768 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-58ca6eca-97f6-4f0f-ac2e-676ba0921261 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:35.490839 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-58ca6eca-97f6-4f0f-ac2e-676ba0921261 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:35.490839 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-58ca6eca-97f6-4f0f-ac2e-676ba0921261 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:35.490839 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-58ca6eca-97f6-4f0f-ac2e-676ba0921261 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:35.490839 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-58ca6eca-97f6-4f0f-ac2e-676ba0921261 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:35.491486 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-58ca6eca-97f6-4f0f-ac2e-676ba0921261 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:35.654197 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-58ca6eca-97f6-4f0f-ac2e-676ba0921261 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:35.663103 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-58ca6eca-97f6-4f0f-ac2e-676ba0921261 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1279 microversion: 2.1 time: 0.193595 Sep 09 13:04:35.663866 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 433/872] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:35 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1279 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:36.687566 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8d184806-951b-41a8-be78-cf0a957a826d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:36.689134 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-8d184806-951b-41a8-be78-cf0a957a826d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:36.696167 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8d184806-951b-41a8-be78-cf0a957a826d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:36.696741 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8d184806-951b-41a8-be78-cf0a957a826d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:36.697434 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8d184806-951b-41a8-be78-cf0a957a826d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:36.698454 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8d184806-951b-41a8-be78-cf0a957a826d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:36.698948 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8d184806-951b-41a8-be78-cf0a957a826d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:36.699452 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8d184806-951b-41a8-be78-cf0a957a826d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:36.849392 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-8d184806-951b-41a8-be78-cf0a957a826d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:36.867729 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-8d184806-951b-41a8-be78-cf0a957a826d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1279 microversion: 2.1 time: 0.185707 Sep 09 13:04:36.868489 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 440/873] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:36 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1279 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:37.890952 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7db9da1e-01b9-4915-abbc-64dcef68f604 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:37.891548 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7db9da1e-01b9-4915-abbc-64dcef68f604 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:37.897945 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7db9da1e-01b9-4915-abbc-64dcef68f604 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:37.898431 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7db9da1e-01b9-4915-abbc-64dcef68f604 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:37.898902 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7db9da1e-01b9-4915-abbc-64dcef68f604 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:37.899583 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7db9da1e-01b9-4915-abbc-64dcef68f604 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:37.900031 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7db9da1e-01b9-4915-abbc-64dcef68f604 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:37.900452 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7db9da1e-01b9-4915-abbc-64dcef68f604 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:38.042076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7db9da1e-01b9-4915-abbc-64dcef68f604 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:38.050102 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7db9da1e-01b9-4915-abbc-64dcef68f604 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1279 microversion: 2.1 time: 0.163232 Sep 09 13:04:38.050268 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-656fcc1c-7a9e-45fb-894d-ee446de483a7 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:04:38.051340 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 434/874] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:37 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1279 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:38.057494 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-656fcc1c-7a9e-45fb-894d-ee446de483a7 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:38.058032 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-656fcc1c-7a9e-45fb-894d-ee446de483a7 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:38.059054 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-656fcc1c-7a9e-45fb-894d-ee446de483a7 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:38.123783 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-656fcc1c-7a9e-45fb-894d-ee446de483a7 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Going to try to stop instance {{(pid=127771) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 13:04:38.131271 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:04:38.282797 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-656fcc1c-7a9e-45fb-894d-ee446de483a7 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "POST /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0/action" status: 202 len: 0 microversion: 2.1 time: 0.236010 Sep 09 13:04:38.286854 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 441/875] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 13:04:38 2022] POST /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 13:04:38.298334 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-3ba91247-8c53-43b5-9df7-58cfeeebddfd tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:38.299100 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-3ba91247-8c53-43b5-9df7-58cfeeebddfd tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:38.307988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3ba91247-8c53-43b5-9df7-58cfeeebddfd tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:38.314105 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3ba91247-8c53-43b5-9df7-58cfeeebddfd tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:38.314105 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3ba91247-8c53-43b5-9df7-58cfeeebddfd tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:38.314105 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3ba91247-8c53-43b5-9df7-58cfeeebddfd tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:38.314105 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3ba91247-8c53-43b5-9df7-58cfeeebddfd tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:38.314577 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3ba91247-8c53-43b5-9df7-58cfeeebddfd tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:38.386866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a553e32d-b0c3-44f8-84eb-8cfd1e69d210 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-121414768", "imageRef": "355bded2-2225-44b2-af86-f9e1861d05ff", "flavorRef": "452", "networks": [{"uuid": "a421270d-c142-4dc1-a03b-7a17f0c5c3b6"}]}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:04:38.445524 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.network.neutron [None req-a553e32d-b0c3-44f8-84eb-8cfd1e69d210 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] validate_networks() for [('a421270d-c142-4dc1-a03b-7a17f0c5c3b6', None, None, None, None, None)] {{(pid=127771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:04:38.459257 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-3ba91247-8c53-43b5-9df7-58cfeeebddfd tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:38.468521 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-3ba91247-8c53-43b5-9df7-58cfeeebddfd tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1724 microversion: 2.1 time: 0.180651 Sep 09 13:04:38.469309 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 435/876] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:38 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:04:38.808695 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-a553e32d-b0c3-44f8-84eb-8cfd1e69d210 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Flavor limits 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:04:38.809229 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-a553e32d-b0c3-44f8-84eb-8cfd1e69d210 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Image limits 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:04:38.809711 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-a553e32d-b0c3-44f8-84eb-8cfd1e69d210 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Flavor pref 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:04:38.810126 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-a553e32d-b0c3-44f8-84eb-8cfd1e69d210 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Image pref 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:04:38.810580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-a553e32d-b0c3-44f8-84eb-8cfd1e69d210 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:04:38.819702 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a553e32d-b0c3-44f8-84eb-8cfd1e69d210 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:38.820198 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a553e32d-b0c3-44f8-84eb-8cfd1e69d210 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:38.820642 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a553e32d-b0c3-44f8-84eb-8cfd1e69d210 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:38.821371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a553e32d-b0c3-44f8-84eb-8cfd1e69d210 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:38.821827 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a553e32d-b0c3-44f8-84eb-8cfd1e69d210 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:38.822251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a553e32d-b0c3-44f8-84eb-8cfd1e69d210 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:38.838818 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-a553e32d-b0c3-44f8-84eb-8cfd1e69d210 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Getting quotas for project 372ca5d37ce94b8fa267f2ee7a81789e. Resources: {'instances', 'cores', 'ram'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:04:38.845819 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-a553e32d-b0c3-44f8-84eb-8cfd1e69d210 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Getting quotas for user c9ac7bf809174b6680a4eb5e088de614 and project 372ca5d37ce94b8fa267f2ee7a81789e. Resources: {'instances', 'cores', 'ram'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:04:38.860935 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-a553e32d-b0c3-44f8-84eb-8cfd1e69d210 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Going to run 1 instances... {{(pid=127771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:04:38.863368 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-a553e32d-b0c3-44f8-84eb-8cfd1e69d210 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 8b44729a-0b11-45eb-a1c3-712b74bd259d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='355bded2-2225-44b2-af86-f9e1861d05ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:04:38.971650 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-a553e32d-b0c3-44f8-84eb-8cfd1e69d210 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589215 Sep 09 13:04:38.972309 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 442/877] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 13:04:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 13:04:38.983919 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-86d7419e-39f5-4f0c-8ff8-e299b9c93b95 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:38.984576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-86d7419e-39f5-4f0c-8ff8-e299b9c93b95 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 8b44729a-0b11-45eb-a1c3-712b74bd259d] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:39.037398 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-86d7419e-39f5-4f0c-8ff8-e299b9c93b95 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:39.045673 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-86d7419e-39f5-4f0c-8ff8-e299b9c93b95 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d" status: 200 len: 1218 microversion: 2.1 time: 0.066187 Sep 09 13:04:39.047115 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 436/878] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:38 2022] GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:39.076953 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-6fd87a10-ccf0-41ac-9829-d3582dace54e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:39.077573 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-6fd87a10-ccf0-41ac-9829-d3582dace54e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:39.084929 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6fd87a10-ccf0-41ac-9829-d3582dace54e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:39.085416 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6fd87a10-ccf0-41ac-9829-d3582dace54e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:39.086177 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6fd87a10-ccf0-41ac-9829-d3582dace54e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:39.087112 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6fd87a10-ccf0-41ac-9829-d3582dace54e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:39.087580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6fd87a10-ccf0-41ac-9829-d3582dace54e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:39.088013 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6fd87a10-ccf0-41ac-9829-d3582dace54e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:39.391823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-6fd87a10-ccf0-41ac-9829-d3582dace54e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:39.400149 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-6fd87a10-ccf0-41ac-9829-d3582dace54e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1267 microversion: 2.1 time: 0.326961 Sep 09 13:04:39.400958 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 443/879] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:39 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1267 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:39.492320 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-f0b01623-20de-4dc2-96d7-e403196950fc tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:39.493107 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-f0b01623-20de-4dc2-96d7-e403196950fc tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:39.502324 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f0b01623-20de-4dc2-96d7-e403196950fc tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:39.503241 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f0b01623-20de-4dc2-96d7-e403196950fc tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:39.503836 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f0b01623-20de-4dc2-96d7-e403196950fc tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:39.504738 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f0b01623-20de-4dc2-96d7-e403196950fc tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:39.505540 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f0b01623-20de-4dc2-96d7-e403196950fc tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:39.506121 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f0b01623-20de-4dc2-96d7-e403196950fc tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:39.724962 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-f0b01623-20de-4dc2-96d7-e403196950fc tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:39.734596 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-f0b01623-20de-4dc2-96d7-e403196950fc tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1724 microversion: 2.1 time: 0.245520 Sep 09 13:04:39.735770 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 437/880] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:39 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:40.067861 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-cfa6a915-00b5-4fe9-8016-91c8e3d19a61 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:40.068479 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-cfa6a915-00b5-4fe9-8016-91c8e3d19a61 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 8b44729a-0b11-45eb-a1c3-712b74bd259d] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:40.070500 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:04:40.075399 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cfa6a915-00b5-4fe9-8016-91c8e3d19a61 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:40.075891 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cfa6a915-00b5-4fe9-8016-91c8e3d19a61 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:40.076414 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cfa6a915-00b5-4fe9-8016-91c8e3d19a61 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:40.077120 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cfa6a915-00b5-4fe9-8016-91c8e3d19a61 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:40.077691 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cfa6a915-00b5-4fe9-8016-91c8e3d19a61 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:40.078311 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cfa6a915-00b5-4fe9-8016-91c8e3d19a61 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:40.144562 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-cfa6a915-00b5-4fe9-8016-91c8e3d19a61 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:40.152630 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-cfa6a915-00b5-4fe9-8016-91c8e3d19a61 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d" status: 200 len: 1222 microversion: 2.1 time: 0.088397 Sep 09 13:04:40.153404 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 444/881] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:40 2022] GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:40.427197 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-73ec538b-f30e-484f-90b7-f5f51dcc8b44 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:40.428083 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-73ec538b-f30e-484f-90b7-f5f51dcc8b44 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:40.430945 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=2 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:04:40.436631 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-73ec538b-f30e-484f-90b7-f5f51dcc8b44 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:40.437120 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-73ec538b-f30e-484f-90b7-f5f51dcc8b44 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:40.437557 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-73ec538b-f30e-484f-90b7-f5f51dcc8b44 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:40.438264 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-73ec538b-f30e-484f-90b7-f5f51dcc8b44 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:40.438742 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-73ec538b-f30e-484f-90b7-f5f51dcc8b44 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:40.439167 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-73ec538b-f30e-484f-90b7-f5f51dcc8b44 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:40.571039 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-73ec538b-f30e-484f-90b7-f5f51dcc8b44 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:40.575472 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:04:40.580020 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-73ec538b-f30e-484f-90b7-f5f51dcc8b44 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1267 microversion: 2.1 time: 0.156858 Sep 09 13:04:40.580577 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 438/882] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:40 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:40.758922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-20eff38c-e143-4730-8d34-26c9503cb892 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:40.759538 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-20eff38c-e143-4730-8d34-26c9503cb892 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:40.766152 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-20eff38c-e143-4730-8d34-26c9503cb892 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:40.766684 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-20eff38c-e143-4730-8d34-26c9503cb892 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:40.767128 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-20eff38c-e143-4730-8d34-26c9503cb892 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:40.767823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-20eff38c-e143-4730-8d34-26c9503cb892 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:40.768283 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-20eff38c-e143-4730-8d34-26c9503cb892 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:40.768716 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-20eff38c-e143-4730-8d34-26c9503cb892 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:40.903879 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-20eff38c-e143-4730-8d34-26c9503cb892 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:40.912162 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-20eff38c-e143-4730-8d34-26c9503cb892 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1724 microversion: 2.1 time: 0.157155 Sep 09 13:04:40.912713 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 445/883] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:40 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:04:41.176088 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-090d8d19-4be3-42aa-b8c8-9cc0451860e9 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:41.176706 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-090d8d19-4be3-42aa-b8c8-9cc0451860e9 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 8b44729a-0b11-45eb-a1c3-712b74bd259d] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:41.184601 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-090d8d19-4be3-42aa-b8c8-9cc0451860e9 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:41.185095 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-090d8d19-4be3-42aa-b8c8-9cc0451860e9 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:41.185527 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-090d8d19-4be3-42aa-b8c8-9cc0451860e9 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:41.186210 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-090d8d19-4be3-42aa-b8c8-9cc0451860e9 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:41.186708 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-090d8d19-4be3-42aa-b8c8-9cc0451860e9 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:41.187136 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-090d8d19-4be3-42aa-b8c8-9cc0451860e9 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:41.252937 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-090d8d19-4be3-42aa-b8c8-9cc0451860e9 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:41.260399 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-090d8d19-4be3-42aa-b8c8-9cc0451860e9 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d" status: 200 len: 1270 microversion: 2.1 time: 0.088253 Sep 09 13:04:41.260950 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 439/884] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:41 2022] GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:41.604703 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a33b0a71-e0b8-4e04-8081-eea0eb1a636c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:41.605426 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-a33b0a71-e0b8-4e04-8081-eea0eb1a636c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:41.613265 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a33b0a71-e0b8-4e04-8081-eea0eb1a636c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:41.613753 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a33b0a71-e0b8-4e04-8081-eea0eb1a636c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:41.614186 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a33b0a71-e0b8-4e04-8081-eea0eb1a636c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:41.615132 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a33b0a71-e0b8-4e04-8081-eea0eb1a636c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:41.615589 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a33b0a71-e0b8-4e04-8081-eea0eb1a636c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:41.616010 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a33b0a71-e0b8-4e04-8081-eea0eb1a636c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:41.749748 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-a33b0a71-e0b8-4e04-8081-eea0eb1a636c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:41.757860 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-a33b0a71-e0b8-4e04-8081-eea0eb1a636c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1267 microversion: 2.1 time: 0.157137 Sep 09 13:04:41.758419 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 446/885] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:41 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:04:41.940844 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-912e4cbb-36a9-4ceb-ac93-91f42997a3e8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:41.941417 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-912e4cbb-36a9-4ceb-ac93-91f42997a3e8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:41.943706 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:04:41.948696 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-912e4cbb-36a9-4ceb-ac93-91f42997a3e8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:41.949185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-912e4cbb-36a9-4ceb-ac93-91f42997a3e8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:41.949619 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-912e4cbb-36a9-4ceb-ac93-91f42997a3e8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:41.950352 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-912e4cbb-36a9-4ceb-ac93-91f42997a3e8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:41.950838 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-912e4cbb-36a9-4ceb-ac93-91f42997a3e8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:41.951257 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-912e4cbb-36a9-4ceb-ac93-91f42997a3e8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:42.141926 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-912e4cbb-36a9-4ceb-ac93-91f42997a3e8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:42.150394 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-912e4cbb-36a9-4ceb-ac93-91f42997a3e8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1724 microversion: 2.1 time: 0.214281 Sep 09 13:04:42.151004 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 440/886] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:41 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:04:42.284745 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-af0568ac-2f6b-423d-8d8e-a9f0ab0e08d6 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:42.285538 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-af0568ac-2f6b-423d-8d8e-a9f0ab0e08d6 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 8b44729a-0b11-45eb-a1c3-712b74bd259d] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:42.291838 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-af0568ac-2f6b-423d-8d8e-a9f0ab0e08d6 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:42.292404 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-af0568ac-2f6b-423d-8d8e-a9f0ab0e08d6 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:42.292848 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-af0568ac-2f6b-423d-8d8e-a9f0ab0e08d6 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:42.293562 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-af0568ac-2f6b-423d-8d8e-a9f0ab0e08d6 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:42.294553 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-af0568ac-2f6b-423d-8d8e-a9f0ab0e08d6 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:42.295065 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-af0568ac-2f6b-423d-8d8e-a9f0ab0e08d6 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:42.429483 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-af0568ac-2f6b-423d-8d8e-a9f0ab0e08d6 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:42.438116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-af0568ac-2f6b-423d-8d8e-a9f0ab0e08d6 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d" status: 200 len: 1318 microversion: 2.1 time: 0.157213 Sep 09 13:04:42.439775 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 447/887] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:42 2022] GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:42.780312 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ece72f91-4d65-44b5-a608-3732a848e021 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:42.780933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-ece72f91-4d65-44b5-a608-3732a848e021 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:42.787368 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ece72f91-4d65-44b5-a608-3732a848e021 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:42.787922 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ece72f91-4d65-44b5-a608-3732a848e021 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:42.788363 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ece72f91-4d65-44b5-a608-3732a848e021 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:42.789054 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ece72f91-4d65-44b5-a608-3732a848e021 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:42.789510 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ece72f91-4d65-44b5-a608-3732a848e021 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:42.789936 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ece72f91-4d65-44b5-a608-3732a848e021 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:43.020327 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ece72f91-4d65-44b5-a608-3732a848e021 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:43.028072 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-ece72f91-4d65-44b5-a608-3732a848e021 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1267 microversion: 2.1 time: 0.251944 Sep 09 13:04:43.028641 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 441/888] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:42 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1267 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:43.174161 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-52ee0270-ec0c-4448-947d-0a87819880e5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:43.174817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-52ee0270-ec0c-4448-947d-0a87819880e5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:43.181122 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52ee0270-ec0c-4448-947d-0a87819880e5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:43.181602 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52ee0270-ec0c-4448-947d-0a87819880e5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:43.184389 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52ee0270-ec0c-4448-947d-0a87819880e5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:43.184389 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52ee0270-ec0c-4448-947d-0a87819880e5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:43.184389 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52ee0270-ec0c-4448-947d-0a87819880e5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:43.184389 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-52ee0270-ec0c-4448-947d-0a87819880e5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:43.299384 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-e024cb0b-8bd4-42a8-966e-803a1117ccc6 req-e39f822e-3669-4494-8459-edc2d88ed67c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b44729a-0b11-45eb-a1c3-712b74bd259d", "tag": "4296eb81-bba7-4d6c-abb4-18d7347a6a9b"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:04:43.312274 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-e024cb0b-8bd4-42a8-966e-803a1117ccc6 req-e39f822e-3669-4494-8459-edc2d88ed67c service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:43.312825 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-e024cb0b-8bd4-42a8-966e-803a1117ccc6 req-e39f822e-3669-4494-8459-edc2d88ed67c service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:43.313966 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-e024cb0b-8bd4-42a8-966e-803a1117ccc6 req-e39f822e-3669-4494-8459-edc2d88ed67c service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:43.318861 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-52ee0270-ec0c-4448-947d-0a87819880e5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:43.327585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-52ee0270-ec0c-4448-947d-0a87819880e5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1724 microversion: 2.1 time: 0.157319 Sep 09 13:04:43.328284 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 448/889] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:43 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:43.329396 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-e024cb0b-8bd4-42a8-966e-803a1117ccc6 req-e39f822e-3669-4494-8459-edc2d88ed67c service nova] Creating event network-changed:4296eb81-bba7-4d6c-abb4-18d7347a6a9b for instance 8b44729a-0b11-45eb-a1c3-712b74bd259d on hv-cinder-81322 Sep 09 13:04:43.335215 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-e024cb0b-8bd4-42a8-966e-803a1117ccc6 req-e39f822e-3669-4494-8459-edc2d88ed67c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044259 Sep 09 13:04:43.335965 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 442/890] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:04:43.461502 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-4f44c280-b881-4c48-bc79-2270907a9ded tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:43.462146 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-4f44c280-b881-4c48-bc79-2270907a9ded tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 8b44729a-0b11-45eb-a1c3-712b74bd259d] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:43.468313 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4f44c280-b881-4c48-bc79-2270907a9ded tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:43.468800 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4f44c280-b881-4c48-bc79-2270907a9ded tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:43.469240 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4f44c280-b881-4c48-bc79-2270907a9ded tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:43.469942 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4f44c280-b881-4c48-bc79-2270907a9ded tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:43.470399 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4f44c280-b881-4c48-bc79-2270907a9ded tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:43.470850 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4f44c280-b881-4c48-bc79-2270907a9ded tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:43.627826 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-4f44c280-b881-4c48-bc79-2270907a9ded tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:43.635834 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-4f44c280-b881-4c48-bc79-2270907a9ded tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d" status: 200 len: 1318 microversion: 2.1 time: 0.178433 Sep 09 13:04:43.636417 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 449/891] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:43 2022] GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:44.051844 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-311cf882-ca80-4196-9343-8d7d91ecd971 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:44.052591 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-311cf882-ca80-4196-9343-8d7d91ecd971 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:44.059308 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-311cf882-ca80-4196-9343-8d7d91ecd971 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:44.059794 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-311cf882-ca80-4196-9343-8d7d91ecd971 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:44.060367 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-311cf882-ca80-4196-9343-8d7d91ecd971 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:44.061049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-311cf882-ca80-4196-9343-8d7d91ecd971 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:44.061509 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-311cf882-ca80-4196-9343-8d7d91ecd971 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:44.061940 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-311cf882-ca80-4196-9343-8d7d91ecd971 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:44.341663 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-311cf882-ca80-4196-9343-8d7d91ecd971 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:44.349611 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-311cf882-ca80-4196-9343-8d7d91ecd971 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1267 microversion: 2.1 time: 0.302030 Sep 09 13:04:44.350172 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 443/892] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:44 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1267 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:44.351686 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-4204ac51-0fbe-46c8-a3a0-f874552324c5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:44.352304 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-4204ac51-0fbe-46c8-a3a0-f874552324c5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:44.359876 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4204ac51-0fbe-46c8-a3a0-f874552324c5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:44.360381 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4204ac51-0fbe-46c8-a3a0-f874552324c5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:44.360820 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4204ac51-0fbe-46c8-a3a0-f874552324c5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:44.361514 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4204ac51-0fbe-46c8-a3a0-f874552324c5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:44.361966 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4204ac51-0fbe-46c8-a3a0-f874552324c5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:44.362388 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4204ac51-0fbe-46c8-a3a0-f874552324c5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:44.490789 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-4204ac51-0fbe-46c8-a3a0-f874552324c5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:44.499452 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-4204ac51-0fbe-46c8-a3a0-f874552324c5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1724 microversion: 2.1 time: 0.151626 Sep 09 13:04:44.500019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 450/893] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:44 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:04:44.659952 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-44f55e1c-4b34-474c-87c2-45aa64901c08 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:44.660569 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-44f55e1c-4b34-474c-87c2-45aa64901c08 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 8b44729a-0b11-45eb-a1c3-712b74bd259d] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:44.666448 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-44f55e1c-4b34-474c-87c2-45aa64901c08 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:44.666965 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-44f55e1c-4b34-474c-87c2-45aa64901c08 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:44.667403 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-44f55e1c-4b34-474c-87c2-45aa64901c08 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:44.668092 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-44f55e1c-4b34-474c-87c2-45aa64901c08 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:44.668545 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-44f55e1c-4b34-474c-87c2-45aa64901c08 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:44.668969 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-44f55e1c-4b34-474c-87c2-45aa64901c08 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:44.863052 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-44f55e1c-4b34-474c-87c2-45aa64901c08 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:44.870605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-44f55e1c-4b34-474c-87c2-45aa64901c08 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d" status: 200 len: 1318 microversion: 2.1 time: 0.214497 Sep 09 13:04:44.871156 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 444/894] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:44 2022] GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:45.374024 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-38b5bf25-ca4e-407f-9b10-9f58e409d8c5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:45.375230 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-38b5bf25-ca4e-407f-9b10-9f58e409d8c5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:45.382103 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-38b5bf25-ca4e-407f-9b10-9f58e409d8c5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:45.382625 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-38b5bf25-ca4e-407f-9b10-9f58e409d8c5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:45.383068 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-38b5bf25-ca4e-407f-9b10-9f58e409d8c5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:45.383760 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-38b5bf25-ca4e-407f-9b10-9f58e409d8c5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:45.384222 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-38b5bf25-ca4e-407f-9b10-9f58e409d8c5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:45.384644 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-38b5bf25-ca4e-407f-9b10-9f58e409d8c5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:45.515972 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-38b5bf25-ca4e-407f-9b10-9f58e409d8c5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:45.523268 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-b0613db7-d6f7-4403-9db7-5031e9903a20 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:45.523883 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-b0613db7-d6f7-4403-9db7-5031e9903a20 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:45.524127 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-38b5bf25-ca4e-407f-9b10-9f58e409d8c5 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1267 microversion: 2.1 time: 0.154712 Sep 09 13:04:45.524704 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 451/895] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:45 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:45.530354 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b0613db7-d6f7-4403-9db7-5031e9903a20 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:45.530877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b0613db7-d6f7-4403-9db7-5031e9903a20 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:45.531970 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b0613db7-d6f7-4403-9db7-5031e9903a20 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:45.533130 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b0613db7-d6f7-4403-9db7-5031e9903a20 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:45.533600 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b0613db7-d6f7-4403-9db7-5031e9903a20 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:45.534182 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b0613db7-d6f7-4403-9db7-5031e9903a20 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:45.667605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-b0613db7-d6f7-4403-9db7-5031e9903a20 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:45.675894 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-b0613db7-d6f7-4403-9db7-5031e9903a20 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1724 microversion: 2.1 time: 0.156445 Sep 09 13:04:45.676455 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 445/896] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:45 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:04:45.893811 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8622a490-0527-4f5e-801d-a9b1f1bd4201 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:45.894443 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-8622a490-0527-4f5e-801d-a9b1f1bd4201 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 8b44729a-0b11-45eb-a1c3-712b74bd259d] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:45.900442 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8622a490-0527-4f5e-801d-a9b1f1bd4201 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:45.900934 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8622a490-0527-4f5e-801d-a9b1f1bd4201 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:45.901381 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8622a490-0527-4f5e-801d-a9b1f1bd4201 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:45.902079 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8622a490-0527-4f5e-801d-a9b1f1bd4201 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:45.902567 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8622a490-0527-4f5e-801d-a9b1f1bd4201 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:45.902999 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8622a490-0527-4f5e-801d-a9b1f1bd4201 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:46.034066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-8622a490-0527-4f5e-801d-a9b1f1bd4201 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:46.041696 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-8622a490-0527-4f5e-801d-a9b1f1bd4201 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d" status: 200 len: 1318 microversion: 2.1 time: 0.151779 Sep 09 13:04:46.042254 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 452/897] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:45 2022] GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:04:46.550433 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-f016ff61-aacd-4942-827d-07a77753f86c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:46.551141 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-f016ff61-aacd-4942-827d-07a77753f86c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:46.557433 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f016ff61-aacd-4942-827d-07a77753f86c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:46.557916 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f016ff61-aacd-4942-827d-07a77753f86c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:46.558353 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f016ff61-aacd-4942-827d-07a77753f86c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:46.559080 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f016ff61-aacd-4942-827d-07a77753f86c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:46.559534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f016ff61-aacd-4942-827d-07a77753f86c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:46.559959 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f016ff61-aacd-4942-827d-07a77753f86c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:46.688623 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-f016ff61-aacd-4942-827d-07a77753f86c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:46.696361 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-f016ff61-aacd-4942-827d-07a77753f86c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1267 microversion: 2.1 time: 0.149808 Sep 09 13:04:46.696921 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 446/898] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:46 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:46.698475 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ff5f821b-8005-4db7-91c6-177610576c41 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:46.699116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ff5f821b-8005-4db7-91c6-177610576c41 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:46.705804 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff5f821b-8005-4db7-91c6-177610576c41 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:46.706300 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff5f821b-8005-4db7-91c6-177610576c41 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:46.706772 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff5f821b-8005-4db7-91c6-177610576c41 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:46.707734 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff5f821b-8005-4db7-91c6-177610576c41 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:46.708193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff5f821b-8005-4db7-91c6-177610576c41 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:46.708652 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ff5f821b-8005-4db7-91c6-177610576c41 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:46.835779 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ff5f821b-8005-4db7-91c6-177610576c41 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:46.844690 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ff5f821b-8005-4db7-91c6-177610576c41 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1724 microversion: 2.1 time: 0.149992 Sep 09 13:04:46.845319 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 453/899] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:46 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:04:47.064478 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-31b6b1af-b306-4d08-b0d7-e2d4facf29d8 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:47.065096 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-31b6b1af-b306-4d08-b0d7-e2d4facf29d8 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 8b44729a-0b11-45eb-a1c3-712b74bd259d] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:47.070994 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-31b6b1af-b306-4d08-b0d7-e2d4facf29d8 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:47.071483 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-31b6b1af-b306-4d08-b0d7-e2d4facf29d8 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:47.071919 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-31b6b1af-b306-4d08-b0d7-e2d4facf29d8 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:47.072608 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-31b6b1af-b306-4d08-b0d7-e2d4facf29d8 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:47.073063 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-31b6b1af-b306-4d08-b0d7-e2d4facf29d8 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:47.073488 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-31b6b1af-b306-4d08-b0d7-e2d4facf29d8 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:47.204649 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-31b6b1af-b306-4d08-b0d7-e2d4facf29d8 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:47.212600 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-31b6b1af-b306-4d08-b0d7-e2d4facf29d8 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d" status: 200 len: 1318 microversion: 2.1 time: 0.152093 Sep 09 13:04:47.213153 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 447/900] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:47 2022] GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:47.720145 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-343538ab-07af-462e-b274-d4e53c70d7a4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:47.720812 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-343538ab-07af-462e-b274-d4e53c70d7a4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:47.727293 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-343538ab-07af-462e-b274-d4e53c70d7a4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:47.727835 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-343538ab-07af-462e-b274-d4e53c70d7a4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:47.731995 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-343538ab-07af-462e-b274-d4e53c70d7a4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:47.731995 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-343538ab-07af-462e-b274-d4e53c70d7a4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:47.731995 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-343538ab-07af-462e-b274-d4e53c70d7a4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:47.731995 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-343538ab-07af-462e-b274-d4e53c70d7a4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:47.867346 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-343538ab-07af-462e-b274-d4e53c70d7a4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:47.869364 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-affa5d09-0dea-4c1e-b3dc-2a87a2eda769 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:47.870577 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-affa5d09-0dea-4c1e-b3dc-2a87a2eda769 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:47.876376 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-343538ab-07af-462e-b274-d4e53c70d7a4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1267 microversion: 2.1 time: 0.160620 Sep 09 13:04:47.876951 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 454/901] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:47 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:47.877840 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-affa5d09-0dea-4c1e-b3dc-2a87a2eda769 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:47.878509 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-affa5d09-0dea-4c1e-b3dc-2a87a2eda769 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:47.879125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-affa5d09-0dea-4c1e-b3dc-2a87a2eda769 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:47.880033 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-affa5d09-0dea-4c1e-b3dc-2a87a2eda769 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:47.880487 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-affa5d09-0dea-4c1e-b3dc-2a87a2eda769 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:47.880912 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-affa5d09-0dea-4c1e-b3dc-2a87a2eda769 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:48.009868 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-affa5d09-0dea-4c1e-b3dc-2a87a2eda769 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:48.018315 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-affa5d09-0dea-4c1e-b3dc-2a87a2eda769 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1724 microversion: 2.1 time: 0.152769 Sep 09 13:04:48.018922 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 448/902] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:47 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:04:48.235583 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-7d608b00-ea8c-4ce8-a7eb-c057477452cc tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:48.236202 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-7d608b00-ea8c-4ce8-a7eb-c057477452cc tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 8b44729a-0b11-45eb-a1c3-712b74bd259d] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:48.242182 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7d608b00-ea8c-4ce8-a7eb-c057477452cc tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:48.242787 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7d608b00-ea8c-4ce8-a7eb-c057477452cc tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:48.243228 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7d608b00-ea8c-4ce8-a7eb-c057477452cc tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:48.243923 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7d608b00-ea8c-4ce8-a7eb-c057477452cc tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:48.244380 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7d608b00-ea8c-4ce8-a7eb-c057477452cc tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:48.244808 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-7d608b00-ea8c-4ce8-a7eb-c057477452cc tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:48.376734 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-7d608b00-ea8c-4ce8-a7eb-c057477452cc tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:48.384388 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-7d608b00-ea8c-4ce8-a7eb-c057477452cc tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d" status: 200 len: 1318 microversion: 2.1 time: 0.152763 Sep 09 13:04:48.384954 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 455/903] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:48 2022] GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:48.899608 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-05f31477-a454-4d38-9846-9d56a5dc7e33 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:48.900225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-05f31477-a454-4d38-9846-9d56a5dc7e33 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:48.906639 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-05f31477-a454-4d38-9846-9d56a5dc7e33 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:48.907123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-05f31477-a454-4d38-9846-9d56a5dc7e33 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:48.907563 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-05f31477-a454-4d38-9846-9d56a5dc7e33 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:48.908249 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-05f31477-a454-4d38-9846-9d56a5dc7e33 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:48.908707 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-05f31477-a454-4d38-9846-9d56a5dc7e33 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:48.909134 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-05f31477-a454-4d38-9846-9d56a5dc7e33 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:49.042317 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-05f31477-a454-4d38-9846-9d56a5dc7e33 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:49.042470 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-f29748f5-fff8-49b1-8155-9f4b86c57ba8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:49.043311 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-f29748f5-fff8-49b1-8155-9f4b86c57ba8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:49.044601 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=8 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:04:49.045811 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=2 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:04:49.046511 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=8 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:04:49.051563 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-05f31477-a454-4d38-9846-9d56a5dc7e33 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1267 microversion: 2.1 time: 0.155817 Sep 09 13:04:49.052042 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f29748f5-fff8-49b1-8155-9f4b86c57ba8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:49.052164 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 449/904] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:48 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:49.052531 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f29748f5-fff8-49b1-8155-9f4b86c57ba8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:49.053017 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f29748f5-fff8-49b1-8155-9f4b86c57ba8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:49.053699 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f29748f5-fff8-49b1-8155-9f4b86c57ba8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:49.054151 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f29748f5-fff8-49b1-8155-9f4b86c57ba8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:49.054598 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f29748f5-fff8-49b1-8155-9f4b86c57ba8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:49.185571 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-f29748f5-fff8-49b1-8155-9f4b86c57ba8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:49.194421 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-f29748f5-fff8-49b1-8155-9f4b86c57ba8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1724 microversion: 2.1 time: 0.155931 Sep 09 13:04:49.195085 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 456/905] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:49 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:49.410356 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-d24085fc-8d06-41c1-b171-05157065963c tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:49.410991 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-d24085fc-8d06-41c1-b171-05157065963c tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 8b44729a-0b11-45eb-a1c3-712b74bd259d] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:49.416963 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d24085fc-8d06-41c1-b171-05157065963c tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:49.417443 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d24085fc-8d06-41c1-b171-05157065963c tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:49.417899 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d24085fc-8d06-41c1-b171-05157065963c tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:49.418620 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d24085fc-8d06-41c1-b171-05157065963c tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:49.419074 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d24085fc-8d06-41c1-b171-05157065963c tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:49.419491 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d24085fc-8d06-41c1-b171-05157065963c tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:49.557054 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-d24085fc-8d06-41c1-b171-05157065963c tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:49.564945 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-d24085fc-8d06-41c1-b171-05157065963c tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d" status: 200 len: 1318 microversion: 2.1 time: 0.159539 Sep 09 13:04:49.565494 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 450/906] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:49 2022] GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:49.682697 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-f9804d3c-cdf9-4528-83f7-b6bf711a7793 req-b66ad390-b7df-48ac-aaa4-d32670767dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b44729a-0b11-45eb-a1c3-712b74bd259d", "name": "network-vif-plugged", "status": "completed", "tag": "4296eb81-bba7-4d6c-abb4-18d7347a6a9b"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:04:49.692529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-f9804d3c-cdf9-4528-83f7-b6bf711a7793 req-b66ad390-b7df-48ac-aaa4-d32670767dc3 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:49.693018 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-f9804d3c-cdf9-4528-83f7-b6bf711a7793 req-b66ad390-b7df-48ac-aaa4-d32670767dc3 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:49.693451 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-f9804d3c-cdf9-4528-83f7-b6bf711a7793 req-b66ad390-b7df-48ac-aaa4-d32670767dc3 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:49.704911 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-f9804d3c-cdf9-4528-83f7-b6bf711a7793 req-b66ad390-b7df-48ac-aaa4-d32670767dc3 service nova] Creating event network-vif-plugged:4296eb81-bba7-4d6c-abb4-18d7347a6a9b for instance 8b44729a-0b11-45eb-a1c3-712b74bd259d on hv-cinder-81322 Sep 09 13:04:49.710306 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-f9804d3c-cdf9-4528-83f7-b6bf711a7793 req-b66ad390-b7df-48ac-aaa4-d32670767dc3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031622 Sep 09 13:04:49.710940 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 457/907] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:04:50.075153 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-58f34a55-b032-4b37-8e9e-6df8a18f0ef0 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:50.075784 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-58f34a55-b032-4b37-8e9e-6df8a18f0ef0 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:50.083095 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-58f34a55-b032-4b37-8e9e-6df8a18f0ef0 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:50.083573 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-58f34a55-b032-4b37-8e9e-6df8a18f0ef0 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:50.084008 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-58f34a55-b032-4b37-8e9e-6df8a18f0ef0 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:50.084696 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-58f34a55-b032-4b37-8e9e-6df8a18f0ef0 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:50.085145 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-58f34a55-b032-4b37-8e9e-6df8a18f0ef0 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:50.085565 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-58f34a55-b032-4b37-8e9e-6df8a18f0ef0 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:50.218188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ce7c1e00-a01f-4617-ae53-b6d312f714bf tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:50.219027 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ce7c1e00-a01f-4617-ae53-b6d312f714bf tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:50.224677 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-58f34a55-b032-4b37-8e9e-6df8a18f0ef0 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:50.225967 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ce7c1e00-a01f-4617-ae53-b6d312f714bf tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:50.226357 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ce7c1e00-a01f-4617-ae53-b6d312f714bf tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:50.226833 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ce7c1e00-a01f-4617-ae53-b6d312f714bf tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:50.227548 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ce7c1e00-a01f-4617-ae53-b6d312f714bf tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:50.228011 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ce7c1e00-a01f-4617-ae53-b6d312f714bf tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:50.228448 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ce7c1e00-a01f-4617-ae53-b6d312f714bf tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:50.232638 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-58f34a55-b032-4b37-8e9e-6df8a18f0ef0 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1267 microversion: 2.1 time: 0.161360 Sep 09 13:04:50.233202 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 451/908] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:50 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:50.362870 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ce7c1e00-a01f-4617-ae53-b6d312f714bf tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:50.366352 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:04:50.371415 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ce7c1e00-a01f-4617-ae53-b6d312f714bf tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1724 microversion: 2.1 time: 0.157614 Sep 09 13:04:50.371967 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 458/909] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:50 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:04:50.589033 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-18c06649-b1b6-4304-81a6-5bfb549ea92f tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:50.589598 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-18c06649-b1b6-4304-81a6-5bfb549ea92f tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 8b44729a-0b11-45eb-a1c3-712b74bd259d] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:50.595748 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-18c06649-b1b6-4304-81a6-5bfb549ea92f tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:50.596203 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-18c06649-b1b6-4304-81a6-5bfb549ea92f tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:50.596635 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-18c06649-b1b6-4304-81a6-5bfb549ea92f tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:50.597328 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-18c06649-b1b6-4304-81a6-5bfb549ea92f tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:50.597778 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-18c06649-b1b6-4304-81a6-5bfb549ea92f tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:50.598200 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-18c06649-b1b6-4304-81a6-5bfb549ea92f tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:50.724360 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-18c06649-b1b6-4304-81a6-5bfb549ea92f tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:50.731980 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-18c06649-b1b6-4304-81a6-5bfb549ea92f tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d" status: 200 len: 1318 microversion: 2.1 time: 0.147000 Sep 09 13:04:50.732526 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 452/910] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:50 2022] GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:51.255468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-4498fd92-e025-4c68-98e0-2ba72c53b294 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:51.256074 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-4498fd92-e025-4c68-98e0-2ba72c53b294 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:51.263210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4498fd92-e025-4c68-98e0-2ba72c53b294 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:51.266875 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4498fd92-e025-4c68-98e0-2ba72c53b294 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:51.266875 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4498fd92-e025-4c68-98e0-2ba72c53b294 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:51.266875 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4498fd92-e025-4c68-98e0-2ba72c53b294 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:51.266875 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4498fd92-e025-4c68-98e0-2ba72c53b294 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:51.267291 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4498fd92-e025-4c68-98e0-2ba72c53b294 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:51.395927 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e79f74c3-04c6-4bd8-8d63-5e6b3c6c1d8c tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:51.396678 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e79f74c3-04c6-4bd8-8d63-5e6b3c6c1d8c tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:51.402983 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-4498fd92-e025-4c68-98e0-2ba72c53b294 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:51.403201 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e79f74c3-04c6-4bd8-8d63-5e6b3c6c1d8c tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:51.403689 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e79f74c3-04c6-4bd8-8d63-5e6b3c6c1d8c tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:51.404125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e79f74c3-04c6-4bd8-8d63-5e6b3c6c1d8c tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:51.404895 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e79f74c3-04c6-4bd8-8d63-5e6b3c6c1d8c tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:51.405268 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e79f74c3-04c6-4bd8-8d63-5e6b3c6c1d8c tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:51.405690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e79f74c3-04c6-4bd8-8d63-5e6b3c6c1d8c tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:51.411131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-4498fd92-e025-4c68-98e0-2ba72c53b294 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1267 microversion: 2.1 time: 0.159488 Sep 09 13:04:51.411845 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 459/911] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:51 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:51.548770 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e79f74c3-04c6-4bd8-8d63-5e6b3c6c1d8c tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:51.558953 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e79f74c3-04c6-4bd8-8d63-5e6b3c6c1d8c tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1724 microversion: 2.1 time: 0.167211 Sep 09 13:04:51.559793 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 453/912] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:51 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:51.726000 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-34a6b116-228d-48eb-b102-7b889b59c0ed req-2d702f93-0a3a-4597-a008-eb3a61ab42f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0325a8c5-db4f-4392-aa58-fc53eb462135", "name": "network-vif-plugged", "status": "completed", "tag": "3222ab4b-e295-4bda-9942-ac4365118d85"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:04:51.735648 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-34a6b116-228d-48eb-b102-7b889b59c0ed req-2d702f93-0a3a-4597-a008-eb3a61ab42f8 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:51.737580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-34a6b116-228d-48eb-b102-7b889b59c0ed req-2d702f93-0a3a-4597-a008-eb3a61ab42f8 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:51.737580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-34a6b116-228d-48eb-b102-7b889b59c0ed req-2d702f93-0a3a-4597-a008-eb3a61ab42f8 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:51.747738 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-34a6b116-228d-48eb-b102-7b889b59c0ed req-2d702f93-0a3a-4597-a008-eb3a61ab42f8 service nova] Creating event network-vif-plugged:3222ab4b-e295-4bda-9942-ac4365118d85 for instance 0325a8c5-db4f-4392-aa58-fc53eb462135 on hv-cinder-81322 Sep 09 13:04:51.753205 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-34a6b116-228d-48eb-b102-7b889b59c0ed req-2d702f93-0a3a-4597-a008-eb3a61ab42f8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030819 Sep 09 13:04:51.754174 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 460/913] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:04:51.756355 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a1d0162d-d4f4-4508-81ce-277de3804bf4 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:51.756981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a1d0162d-d4f4-4508-81ce-277de3804bf4 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 8b44729a-0b11-45eb-a1c3-712b74bd259d] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:51.763017 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a1d0162d-d4f4-4508-81ce-277de3804bf4 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:51.767595 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a1d0162d-d4f4-4508-81ce-277de3804bf4 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:51.767595 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a1d0162d-d4f4-4508-81ce-277de3804bf4 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:51.767595 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a1d0162d-d4f4-4508-81ce-277de3804bf4 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:51.767595 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a1d0162d-d4f4-4508-81ce-277de3804bf4 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:51.768016 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a1d0162d-d4f4-4508-81ce-277de3804bf4 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:51.904132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a1d0162d-d4f4-4508-81ce-277de3804bf4 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:51.912731 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a1d0162d-d4f4-4508-81ce-277de3804bf4 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d" status: 200 len: 1507 microversion: 2.1 time: 0.161047 Sep 09 13:04:51.913296 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 454/914] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:51 2022] GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:04:52.434155 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-47be95b8-269a-498d-97c9-aa67364d89e8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:52.434886 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-47be95b8-269a-498d-97c9-aa67364d89e8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:52.442067 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47be95b8-269a-498d-97c9-aa67364d89e8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:52.442607 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47be95b8-269a-498d-97c9-aa67364d89e8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:52.443049 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47be95b8-269a-498d-97c9-aa67364d89e8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:52.443745 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47be95b8-269a-498d-97c9-aa67364d89e8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:52.444200 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47be95b8-269a-498d-97c9-aa67364d89e8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:52.444630 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-47be95b8-269a-498d-97c9-aa67364d89e8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:52.588219 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-d3535894-47c7-4ba1-b3bc-433806e95ada tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:52.588904 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-d3535894-47c7-4ba1-b3bc-433806e95ada tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:52.595375 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d3535894-47c7-4ba1-b3bc-433806e95ada tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:52.596156 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d3535894-47c7-4ba1-b3bc-433806e95ada tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:52.596960 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d3535894-47c7-4ba1-b3bc-433806e95ada tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:52.597734 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d3535894-47c7-4ba1-b3bc-433806e95ada tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:52.598258 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d3535894-47c7-4ba1-b3bc-433806e95ada tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:52.598784 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d3535894-47c7-4ba1-b3bc-433806e95ada tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:52.606848 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-47be95b8-269a-498d-97c9-aa67364d89e8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:52.618455 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-47be95b8-269a-498d-97c9-aa67364d89e8 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1267 microversion: 2.1 time: 0.188907 Sep 09 13:04:52.619180 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 461/915] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:52 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:52.736723 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-d3535894-47c7-4ba1-b3bc-433806e95ada tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:52.745079 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-d3535894-47c7-4ba1-b3bc-433806e95ada tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1724 microversion: 2.1 time: 0.161124 Sep 09 13:04:52.745642 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 455/916] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:52 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:04:53.643770 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8bfbfb16-9ebb-4c4f-a406-f537b2ac318e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:53.644407 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-8bfbfb16-9ebb-4c4f-a406-f537b2ac318e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:53.650504 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8bfbfb16-9ebb-4c4f-a406-f537b2ac318e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:53.651221 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8bfbfb16-9ebb-4c4f-a406-f537b2ac318e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:53.651516 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8bfbfb16-9ebb-4c4f-a406-f537b2ac318e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:53.652410 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8bfbfb16-9ebb-4c4f-a406-f537b2ac318e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:53.652918 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8bfbfb16-9ebb-4c4f-a406-f537b2ac318e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:53.653161 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8bfbfb16-9ebb-4c4f-a406-f537b2ac318e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:53.768817 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-6de08eeb-f887-40c6-9732-d3a56345a041 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:53.769485 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-6de08eeb-f887-40c6-9732-d3a56345a041 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:53.775936 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6de08eeb-f887-40c6-9732-d3a56345a041 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:53.776421 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6de08eeb-f887-40c6-9732-d3a56345a041 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:53.777053 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6de08eeb-f887-40c6-9732-d3a56345a041 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:53.777754 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6de08eeb-f887-40c6-9732-d3a56345a041 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:53.778212 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6de08eeb-f887-40c6-9732-d3a56345a041 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:53.778671 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6de08eeb-f887-40c6-9732-d3a56345a041 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:53.783997 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=100 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:04:53.800414 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-8bfbfb16-9ebb-4c4f-a406-f537b2ac318e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:53.808179 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-8bfbfb16-9ebb-4c4f-a406-f537b2ac318e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1454 microversion: 2.1 time: 0.168979 Sep 09 13:04:53.808745 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 462/917] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:53 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:04:53.831487 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-08f990db-09fc-4ca2-bc5c-1bb5f87cbe40 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:53.832352 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-08f990db-09fc-4ca2-bc5c-1bb5f87cbe40 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:53.838800 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-08f990db-09fc-4ca2-bc5c-1bb5f87cbe40 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:53.839296 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-08f990db-09fc-4ca2-bc5c-1bb5f87cbe40 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:53.839731 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-08f990db-09fc-4ca2-bc5c-1bb5f87cbe40 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:53.840428 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-08f990db-09fc-4ca2-bc5c-1bb5f87cbe40 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:53.840884 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-08f990db-09fc-4ca2-bc5c-1bb5f87cbe40 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:53.841383 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-08f990db-09fc-4ca2-bc5c-1bb5f87cbe40 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:53.932382 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-6de08eeb-f887-40c6-9732-d3a56345a041 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:53.945106 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-6de08eeb-f887-40c6-9732-d3a56345a041 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1701 microversion: 2.1 time: 0.177849 Sep 09 13:04:53.945106 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 456/918] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:53 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1701 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:04:53.966141 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e9e8dd46-8be6-45c2-bb55-0e4a4ea07f6d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:04:53.973335 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e9e8dd46-8be6-45c2-bb55-0e4a4ea07f6d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:53.973876 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e9e8dd46-8be6-45c2-bb55-0e4a4ea07f6d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:53.974320 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e9e8dd46-8be6-45c2-bb55-0e4a4ea07f6d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:53.989164 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-08f990db-09fc-4ca2-bc5c-1bb5f87cbe40 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:53.997162 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-08f990db-09fc-4ca2-bc5c-1bb5f87cbe40 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1454 microversion: 2.1 time: 0.169545 Sep 09 13:04:53.997718 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 463/919] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:53 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:04:54.040998 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e9e8dd46-8be6-45c2-bb55-0e4a4ea07f6d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Going to try to start instance {{(pid=127772) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 13:04:54.223230 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e9e8dd46-8be6-45c2-bb55-0e4a4ea07f6d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "POST /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0/action" status: 202 len: 0 microversion: 2.1 time: 0.260951 Sep 09 13:04:54.223865 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 457/920] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 13:04:53 2022] POST /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 13:04:54.232235 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-5a8becd0-f175-42e0-9135-ae3ea1b75e13 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:54.232891 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-5a8becd0-f175-42e0-9135-ae3ea1b75e13 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:54.239121 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a8becd0-f175-42e0-9135-ae3ea1b75e13 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:54.239614 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a8becd0-f175-42e0-9135-ae3ea1b75e13 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:54.240052 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a8becd0-f175-42e0-9135-ae3ea1b75e13 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:54.240763 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a8becd0-f175-42e0-9135-ae3ea1b75e13 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:54.241280 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a8becd0-f175-42e0-9135-ae3ea1b75e13 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:54.243937 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a8becd0-f175-42e0-9135-ae3ea1b75e13 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:54.384262 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-5a8becd0-f175-42e0-9135-ae3ea1b75e13 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:54.393061 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-5a8becd0-f175-42e0-9135-ae3ea1b75e13 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1710 microversion: 2.1 time: 0.164711 Sep 09 13:04:54.402282 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 464/921] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:54 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1710 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:55.417183 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-8bf470af-235c-4abd-a3ee-5b1b4b043f7a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:55.418706 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-8bf470af-235c-4abd-a3ee-5b1b4b043f7a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:55.425123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8bf470af-235c-4abd-a3ee-5b1b4b043f7a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:55.425819 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8bf470af-235c-4abd-a3ee-5b1b4b043f7a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:55.426264 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8bf470af-235c-4abd-a3ee-5b1b4b043f7a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:55.427004 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8bf470af-235c-4abd-a3ee-5b1b4b043f7a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:55.427470 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8bf470af-235c-4abd-a3ee-5b1b4b043f7a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:55.427958 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8bf470af-235c-4abd-a3ee-5b1b4b043f7a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:55.630301 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-8bf470af-235c-4abd-a3ee-5b1b4b043f7a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:55.638994 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-8bf470af-235c-4abd-a3ee-5b1b4b043f7a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1710 microversion: 2.1 time: 0.226315 Sep 09 13:04:55.639561 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 458/922] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:55 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1710 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:04:56.515745 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-5b7a405c-6747-4e81-8866-9525530d6d7d req-b2165df6-e5e5-48af-9e5f-0736bb1553e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0325a8c5-db4f-4392-aa58-fc53eb462135", "tag": "3222ab4b-e295-4bda-9942-ac4365118d85"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:04:56.529178 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-5b7a405c-6747-4e81-8866-9525530d6d7d req-b2165df6-e5e5-48af-9e5f-0736bb1553e0 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:56.529851 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-5b7a405c-6747-4e81-8866-9525530d6d7d req-b2165df6-e5e5-48af-9e5f-0736bb1553e0 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:56.531300 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-5b7a405c-6747-4e81-8866-9525530d6d7d req-b2165df6-e5e5-48af-9e5f-0736bb1553e0 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:56.545851 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-5b7a405c-6747-4e81-8866-9525530d6d7d req-b2165df6-e5e5-48af-9e5f-0736bb1553e0 service nova] Creating event network-changed:3222ab4b-e295-4bda-9942-ac4365118d85 for instance 0325a8c5-db4f-4392-aa58-fc53eb462135 on hv-cinder-81322 Sep 09 13:04:56.552524 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-5b7a405c-6747-4e81-8866-9525530d6d7d req-b2165df6-e5e5-48af-9e5f-0736bb1553e0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042093 Sep 09 13:04:56.553303 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 465/923] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:04:56.664675 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-326240fb-2ecc-4d81-bf26-c2f52c9e8a71 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:04:56.665282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-326240fb-2ecc-4d81-bf26-c2f52c9e8a71 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:04:56.671824 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-326240fb-2ecc-4d81-bf26-c2f52c9e8a71 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:56.672406 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-326240fb-2ecc-4d81-bf26-c2f52c9e8a71 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:56.673839 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-326240fb-2ecc-4d81-bf26-c2f52c9e8a71 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:56.674458 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-326240fb-2ecc-4d81-bf26-c2f52c9e8a71 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:04:56.675167 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-326240fb-2ecc-4d81-bf26-c2f52c9e8a71 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:04:56.675622 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-326240fb-2ecc-4d81-bf26-c2f52c9e8a71 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:04:56.897044 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-326240fb-2ecc-4d81-bf26-c2f52c9e8a71 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:04:56.906136 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-326240fb-2ecc-4d81-bf26-c2f52c9e8a71 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1714 microversion: 2.1 time: 0.245912 Sep 09 13:04:56.906786 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 459/924] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:04:56 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1714 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:08.476075 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-6dd593ba-e86c-4a0a-aa69-8972f0082adb tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5a2c876-7c77-4839-ae61-fa267f95830e", "device": "/dev/sdb"}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:05:08.479018 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-6dd593ba-e86c-4a0a-aa69-8972f0082adb tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 8b44729a-0b11-45eb-a1c3-712b74bd259d] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:08.481801 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=43 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:05:08.482630 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=34 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:05:08.487448 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6dd593ba-e86c-4a0a-aa69-8972f0082adb tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:08.487990 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6dd593ba-e86c-4a0a-aa69-8972f0082adb tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:08.488752 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6dd593ba-e86c-4a0a-aa69-8972f0082adb tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:08.489878 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6dd593ba-e86c-4a0a-aa69-8972f0082adb tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:08.490631 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6dd593ba-e86c-4a0a-aa69-8972f0082adb tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:08.491301 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6dd593ba-e86c-4a0a-aa69-8972f0082adb tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:09.177754 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-6dd593ba-e86c-4a0a-aa69-8972f0082adb tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "POST /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.706537 Sep 09 13:05:09.178375 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 466/925] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 13:05:08 2022] POST /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d/os-volume_attachments => generated 194 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:05:15.386835 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-87eeed52-8fbe-47ea-8e30-b34ff3fafc0a tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:05:15.387356 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-87eeed52-8fbe-47ea-8e30-b34ff3fafc0a tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:15.390016 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=39 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:05:15.390704 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:05:15.395817 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-87eeed52-8fbe-47ea-8e30-b34ff3fafc0a tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:15.396301 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-87eeed52-8fbe-47ea-8e30-b34ff3fafc0a tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:15.402768 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-87eeed52-8fbe-47ea-8e30-b34ff3fafc0a tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:15.402768 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-87eeed52-8fbe-47ea-8e30-b34ff3fafc0a tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:15.402768 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-87eeed52-8fbe-47ea-8e30-b34ff3fafc0a tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:15.402768 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-87eeed52-8fbe-47ea-8e30-b34ff3fafc0a tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:15.421479 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.objects.instance [None req-87eeed52-8fbe-47ea-8e30-b34ff3fafc0a tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lazy-loading 'flavor' on Instance uuid 10884cc0-9f01-425e-8d5f-9e0727a68b5e {{(pid=127772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:05:15.664977 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-87eeed52-8fbe-47ea-8e30-b34ff3fafc0a tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "POST /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e/action" status: 202 len: 0 microversion: 2.1 time: 0.282026 Sep 09 13:05:15.665597 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 460/926] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 13:05:15 2022] POST /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:05:15.674659 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-50bda86c-9fee-4dd1-973a-da004452aed6 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:15.675366 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-50bda86c-9fee-4dd1-973a-da004452aed6 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:15.684295 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-50bda86c-9fee-4dd1-973a-da004452aed6 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:15.684782 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-50bda86c-9fee-4dd1-973a-da004452aed6 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:15.685221 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-50bda86c-9fee-4dd1-973a-da004452aed6 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:15.685922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-50bda86c-9fee-4dd1-973a-da004452aed6 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:15.686380 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-50bda86c-9fee-4dd1-973a-da004452aed6 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:15.686835 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-50bda86c-9fee-4dd1-973a-da004452aed6 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:15.821844 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-50bda86c-9fee-4dd1-973a-da004452aed6 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:15.829625 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-50bda86c-9fee-4dd1-973a-da004452aed6 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1568 microversion: 2.1 time: 0.159483 Sep 09 13:05:15.830178 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 467/927] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:15 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:16.854858 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-0497f102-ec9a-4375-a846-d0be573e1780 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:16.855559 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-0497f102-ec9a-4375-a846-d0be573e1780 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:16.861634 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0497f102-ec9a-4375-a846-d0be573e1780 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:16.862119 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0497f102-ec9a-4375-a846-d0be573e1780 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:16.862613 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0497f102-ec9a-4375-a846-d0be573e1780 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:16.863308 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0497f102-ec9a-4375-a846-d0be573e1780 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:16.863769 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0497f102-ec9a-4375-a846-d0be573e1780 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:16.864784 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0497f102-ec9a-4375-a846-d0be573e1780 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:17.001516 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-0497f102-ec9a-4375-a846-d0be573e1780 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:17.009207 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-0497f102-ec9a-4375-a846-d0be573e1780 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1568 microversion: 2.1 time: 0.159073 Sep 09 13:05:17.009768 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 461/928] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:16 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:18.032501 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-65d6a036-df2d-4eba-b94e-16a2d20f6665 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:18.033132 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-65d6a036-df2d-4eba-b94e-16a2d20f6665 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:18.039641 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-65d6a036-df2d-4eba-b94e-16a2d20f6665 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:18.040128 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-65d6a036-df2d-4eba-b94e-16a2d20f6665 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:18.040563 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-65d6a036-df2d-4eba-b94e-16a2d20f6665 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:18.041246 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-65d6a036-df2d-4eba-b94e-16a2d20f6665 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:18.041696 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-65d6a036-df2d-4eba-b94e-16a2d20f6665 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:18.042120 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-65d6a036-df2d-4eba-b94e-16a2d20f6665 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:18.174443 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-65d6a036-df2d-4eba-b94e-16a2d20f6665 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:18.182811 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-65d6a036-df2d-4eba-b94e-16a2d20f6665 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1568 microversion: 2.1 time: 0.154150 Sep 09 13:05:18.183374 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 468/929] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:18 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:19.207331 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-d7274f51-ee5f-467d-8dfe-682fcaba852c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:19.208373 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-d7274f51-ee5f-467d-8dfe-682fcaba852c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:19.214698 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d7274f51-ee5f-467d-8dfe-682fcaba852c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:19.216807 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d7274f51-ee5f-467d-8dfe-682fcaba852c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:19.216807 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d7274f51-ee5f-467d-8dfe-682fcaba852c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:19.216807 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d7274f51-ee5f-467d-8dfe-682fcaba852c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:19.216807 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d7274f51-ee5f-467d-8dfe-682fcaba852c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:19.217199 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d7274f51-ee5f-467d-8dfe-682fcaba852c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:19.351625 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-d7274f51-ee5f-467d-8dfe-682fcaba852c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:19.359325 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-d7274f51-ee5f-467d-8dfe-682fcaba852c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1568 microversion: 2.1 time: 0.155940 Sep 09 13:05:19.359881 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 462/930] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:19 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:20.383891 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-c9f9f8d7-1d0c-4c5c-a500-64d4702fb9e3 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:20.384446 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-c9f9f8d7-1d0c-4c5c-a500-64d4702fb9e3 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:20.391166 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c9f9f8d7-1d0c-4c5c-a500-64d4702fb9e3 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:20.391649 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c9f9f8d7-1d0c-4c5c-a500-64d4702fb9e3 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:20.392082 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c9f9f8d7-1d0c-4c5c-a500-64d4702fb9e3 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:20.392758 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c9f9f8d7-1d0c-4c5c-a500-64d4702fb9e3 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:20.393215 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c9f9f8d7-1d0c-4c5c-a500-64d4702fb9e3 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:20.393638 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c9f9f8d7-1d0c-4c5c-a500-64d4702fb9e3 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:20.524279 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-c9f9f8d7-1d0c-4c5c-a500-64d4702fb9e3 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:20.534041 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-c9f9f8d7-1d0c-4c5c-a500-64d4702fb9e3 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1568 microversion: 2.1 time: 0.154675 Sep 09 13:05:20.534631 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 469/931] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:20 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:21.557205 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-90532b6e-26b3-4af3-8f6b-0c7f9178ebaf tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:21.557828 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-90532b6e-26b3-4af3-8f6b-0c7f9178ebaf tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:21.564272 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-90532b6e-26b3-4af3-8f6b-0c7f9178ebaf tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:21.564762 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-90532b6e-26b3-4af3-8f6b-0c7f9178ebaf tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:21.565208 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-90532b6e-26b3-4af3-8f6b-0c7f9178ebaf tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:21.565916 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-90532b6e-26b3-4af3-8f6b-0c7f9178ebaf tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:21.566385 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-90532b6e-26b3-4af3-8f6b-0c7f9178ebaf tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:21.566900 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-90532b6e-26b3-4af3-8f6b-0c7f9178ebaf tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:21.702644 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-90532b6e-26b3-4af3-8f6b-0c7f9178ebaf tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:21.710856 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-90532b6e-26b3-4af3-8f6b-0c7f9178ebaf tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1568 microversion: 2.1 time: 0.157600 Sep 09 13:05:21.711424 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 463/932] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:21 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:22.733002 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-9329184d-5be6-4b4f-8461-c68f74aa5e0f tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:22.733617 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-9329184d-5be6-4b4f-8461-c68f74aa5e0f tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:22.740093 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9329184d-5be6-4b4f-8461-c68f74aa5e0f tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:22.740540 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9329184d-5be6-4b4f-8461-c68f74aa5e0f tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:22.740980 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9329184d-5be6-4b4f-8461-c68f74aa5e0f tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:22.741668 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9329184d-5be6-4b4f-8461-c68f74aa5e0f tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:22.742117 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9329184d-5be6-4b4f-8461-c68f74aa5e0f tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:22.742568 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9329184d-5be6-4b4f-8461-c68f74aa5e0f tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:22.878990 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-9329184d-5be6-4b4f-8461-c68f74aa5e0f tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:22.887190 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-9329184d-5be6-4b4f-8461-c68f74aa5e0f tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1568 microversion: 2.1 time: 0.158031 Sep 09 13:05:22.887751 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 470/933] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:22 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:23.910857 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-043a1cdf-5e9f-4b97-8e68-fc0beac58972 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:23.914294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-043a1cdf-5e9f-4b97-8e68-fc0beac58972 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:23.918557 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-043a1cdf-5e9f-4b97-8e68-fc0beac58972 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:23.919036 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-043a1cdf-5e9f-4b97-8e68-fc0beac58972 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:23.919469 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-043a1cdf-5e9f-4b97-8e68-fc0beac58972 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:23.920181 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-043a1cdf-5e9f-4b97-8e68-fc0beac58972 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:23.920633 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-043a1cdf-5e9f-4b97-8e68-fc0beac58972 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:23.921057 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-043a1cdf-5e9f-4b97-8e68-fc0beac58972 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:24.054871 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-043a1cdf-5e9f-4b97-8e68-fc0beac58972 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:24.062590 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-043a1cdf-5e9f-4b97-8e68-fc0beac58972 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1568 microversion: 2.1 time: 0.155676 Sep 09 13:05:24.063153 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 464/934] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:23 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:25.085484 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0af2dbaf-fb12-46a4-b431-d22a4474c7be tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:25.086021 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-0af2dbaf-fb12-46a4-b431-d22a4474c7be tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:25.092484 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0af2dbaf-fb12-46a4-b431-d22a4474c7be tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:25.092964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0af2dbaf-fb12-46a4-b431-d22a4474c7be tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:25.093398 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0af2dbaf-fb12-46a4-b431-d22a4474c7be tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:25.094082 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0af2dbaf-fb12-46a4-b431-d22a4474c7be tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:25.094566 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0af2dbaf-fb12-46a4-b431-d22a4474c7be tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:25.094994 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0af2dbaf-fb12-46a4-b431-d22a4474c7be tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:25.227390 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-0af2dbaf-fb12-46a4-b431-d22a4474c7be tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:25.235214 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0af2dbaf-fb12-46a4-b431-d22a4474c7be tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1568 microversion: 2.1 time: 0.153950 Sep 09 13:05:25.235783 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 471/935] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:25 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:26.259968 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e7ee9829-8bdc-47f8-8e0c-da12e05d86e9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:26.260720 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e7ee9829-8bdc-47f8-8e0c-da12e05d86e9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:26.267096 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e7ee9829-8bdc-47f8-8e0c-da12e05d86e9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:26.267617 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e7ee9829-8bdc-47f8-8e0c-da12e05d86e9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:26.268057 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e7ee9829-8bdc-47f8-8e0c-da12e05d86e9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:26.268753 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e7ee9829-8bdc-47f8-8e0c-da12e05d86e9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:26.269209 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e7ee9829-8bdc-47f8-8e0c-da12e05d86e9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:26.269635 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e7ee9829-8bdc-47f8-8e0c-da12e05d86e9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:26.400840 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e7ee9829-8bdc-47f8-8e0c-da12e05d86e9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:26.408534 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e7ee9829-8bdc-47f8-8e0c-da12e05d86e9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1568 microversion: 2.1 time: 0.153427 Sep 09 13:05:26.409085 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 465/936] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:26 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:27.434887 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ce4fa2ad-9e23-4844-8571-b8c533bfdc09 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:27.435411 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ce4fa2ad-9e23-4844-8571-b8c533bfdc09 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:27.441837 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ce4fa2ad-9e23-4844-8571-b8c533bfdc09 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:27.442319 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ce4fa2ad-9e23-4844-8571-b8c533bfdc09 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:27.442792 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ce4fa2ad-9e23-4844-8571-b8c533bfdc09 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:27.443711 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ce4fa2ad-9e23-4844-8571-b8c533bfdc09 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:27.444182 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ce4fa2ad-9e23-4844-8571-b8c533bfdc09 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:27.444593 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ce4fa2ad-9e23-4844-8571-b8c533bfdc09 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:27.574054 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ce4fa2ad-9e23-4844-8571-b8c533bfdc09 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:27.581774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ce4fa2ad-9e23-4844-8571-b8c533bfdc09 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1568 microversion: 2.1 time: 0.150923 Sep 09 13:05:27.582337 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 472/937] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:27 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:28.606857 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-28bd6197-6082-44cb-90c0-435946a050c9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:28.607476 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-28bd6197-6082-44cb-90c0-435946a050c9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:28.613809 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-28bd6197-6082-44cb-90c0-435946a050c9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:28.614290 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-28bd6197-6082-44cb-90c0-435946a050c9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:28.614758 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-28bd6197-6082-44cb-90c0-435946a050c9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:28.616200 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-28bd6197-6082-44cb-90c0-435946a050c9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:28.616902 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-28bd6197-6082-44cb-90c0-435946a050c9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:28.617336 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-28bd6197-6082-44cb-90c0-435946a050c9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:28.753729 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-28bd6197-6082-44cb-90c0-435946a050c9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:28.762628 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-28bd6197-6082-44cb-90c0-435946a050c9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1568 microversion: 2.1 time: 0.159611 Sep 09 13:05:28.763199 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 466/938] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:28 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:29.785238 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-6b59c00c-d2b2-4191-b027-0f74b09c822a tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:29.785862 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-6b59c00c-d2b2-4191-b027-0f74b09c822a tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:29.792481 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6b59c00c-d2b2-4191-b027-0f74b09c822a tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:29.792962 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6b59c00c-d2b2-4191-b027-0f74b09c822a tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:29.793400 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6b59c00c-d2b2-4191-b027-0f74b09c822a tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:29.794086 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6b59c00c-d2b2-4191-b027-0f74b09c822a tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:29.794567 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6b59c00c-d2b2-4191-b027-0f74b09c822a tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:29.799193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6b59c00c-d2b2-4191-b027-0f74b09c822a tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:29.935982 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-6b59c00c-d2b2-4191-b027-0f74b09c822a tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:29.943944 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-6b59c00c-d2b2-4191-b027-0f74b09c822a tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1568 microversion: 2.1 time: 0.162452 Sep 09 13:05:29.944597 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 473/939] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:29 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:30.968144 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-44af653d-5b73-4dc3-8265-8434abb44801 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:30.968761 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-44af653d-5b73-4dc3-8265-8434abb44801 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:30.976476 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-44af653d-5b73-4dc3-8265-8434abb44801 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:30.976967 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-44af653d-5b73-4dc3-8265-8434abb44801 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:30.977757 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-44af653d-5b73-4dc3-8265-8434abb44801 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:30.978119 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-44af653d-5b73-4dc3-8265-8434abb44801 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:30.978669 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-44af653d-5b73-4dc3-8265-8434abb44801 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:30.979035 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-44af653d-5b73-4dc3-8265-8434abb44801 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:31.129697 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-44af653d-5b73-4dc3-8265-8434abb44801 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:31.141091 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-44af653d-5b73-4dc3-8265-8434abb44801 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1568 microversion: 2.1 time: 0.176737 Sep 09 13:05:31.142048 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 467/940] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:30 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:32.172250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-459848ad-8e33-433b-b6a7-fa02c8194113 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:32.172870 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-459848ad-8e33-433b-b6a7-fa02c8194113 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:32.180225 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-459848ad-8e33-433b-b6a7-fa02c8194113 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:32.180782 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-459848ad-8e33-433b-b6a7-fa02c8194113 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:32.181234 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-459848ad-8e33-433b-b6a7-fa02c8194113 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:32.182011 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-459848ad-8e33-433b-b6a7-fa02c8194113 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:32.182477 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-459848ad-8e33-433b-b6a7-fa02c8194113 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:32.187885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-459848ad-8e33-433b-b6a7-fa02c8194113 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:32.313131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-459848ad-8e33-433b-b6a7-fa02c8194113 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:32.321572 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-459848ad-8e33-433b-b6a7-fa02c8194113 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1568 microversion: 2.1 time: 0.153415 Sep 09 13:05:32.322142 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 474/941] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:32 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:33.345670 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-23d92fd8-124a-4acb-b034-de1ec487b1ee tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:33.346276 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-23d92fd8-124a-4acb-b034-de1ec487b1ee tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:33.353002 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-23d92fd8-124a-4acb-b034-de1ec487b1ee tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:33.353492 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-23d92fd8-124a-4acb-b034-de1ec487b1ee tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:33.353991 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-23d92fd8-124a-4acb-b034-de1ec487b1ee tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:33.354744 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-23d92fd8-124a-4acb-b034-de1ec487b1ee tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:33.355204 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-23d92fd8-124a-4acb-b034-de1ec487b1ee tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:33.355656 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-23d92fd8-124a-4acb-b034-de1ec487b1ee tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:33.485526 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-23d92fd8-124a-4acb-b034-de1ec487b1ee tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:33.493238 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-23d92fd8-124a-4acb-b034-de1ec487b1ee tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1568 microversion: 2.1 time: 0.151716 Sep 09 13:05:33.493800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 468/942] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:33 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:33.930942 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-f0d9d354-4691-4fcf-8b64-a314db3a7128 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:33.930942 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-f0d9d354-4691-4fcf-8b64-a314db3a7128 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 8b44729a-0b11-45eb-a1c3-712b74bd259d] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:33.934167 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f0d9d354-4691-4fcf-8b64-a314db3a7128 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:33.934719 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f0d9d354-4691-4fcf-8b64-a314db3a7128 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:33.935171 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f0d9d354-4691-4fcf-8b64-a314db3a7128 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:33.935935 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f0d9d354-4691-4fcf-8b64-a314db3a7128 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:33.936522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f0d9d354-4691-4fcf-8b64-a314db3a7128 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:33.937016 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f0d9d354-4691-4fcf-8b64-a314db3a7128 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:34.019974 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.objects.instance [None req-f0d9d354-4691-4fcf-8b64-a314db3a7128 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lazy-loading 'services' on Instance uuid 8b44729a-0b11-45eb-a1c3-712b74bd259d {{(pid=127771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:05:34.223015 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-f0d9d354-4691-4fcf-8b64-a314db3a7128 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d/os-volume_attachments/d5a2c876-7c77-4839-ae61-fa267f95830e" status: 202 len: 0 microversion: 2.1 time: 0.300491 Sep 09 13:05:34.223616 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 475/943] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 13:05:33 2022] DELETE /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d/os-volume_attachments/d5a2c876-7c77-4839-ae61-fa267f95830e => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:05:34.516248 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-1d813702-075b-46a1-bdae-0927a72036b2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:34.516814 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-1d813702-075b-46a1-bdae-0927a72036b2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:34.523240 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1d813702-075b-46a1-bdae-0927a72036b2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:34.523726 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1d813702-075b-46a1-bdae-0927a72036b2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:34.524166 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1d813702-075b-46a1-bdae-0927a72036b2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:34.525500 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1d813702-075b-46a1-bdae-0927a72036b2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:34.525959 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1d813702-075b-46a1-bdae-0927a72036b2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:34.526388 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1d813702-075b-46a1-bdae-0927a72036b2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:34.659992 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-1d813702-075b-46a1-bdae-0927a72036b2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:34.668587 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-1d813702-075b-46a1-bdae-0927a72036b2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1568 microversion: 2.1 time: 0.156398 Sep 09 13:05:34.669154 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 469/944] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:34 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:35.358241 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-1d2bd32b-95c6-4164-b16d-015077f4925a tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:35.359087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-1d2bd32b-95c6-4164-b16d-015077f4925a tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 8b44729a-0b11-45eb-a1c3-712b74bd259d] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:35.365930 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1d2bd32b-95c6-4164-b16d-015077f4925a tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:35.372282 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1d2bd32b-95c6-4164-b16d-015077f4925a tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:35.372282 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1d2bd32b-95c6-4164-b16d-015077f4925a tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:35.372282 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1d2bd32b-95c6-4164-b16d-015077f4925a tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:35.372282 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1d2bd32b-95c6-4164-b16d-015077f4925a tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:35.372666 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1d2bd32b-95c6-4164-b16d-015077f4925a tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:35.399352 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-1d2bd32b-95c6-4164-b16d-015077f4925a tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 8b44729a-0b11-45eb-a1c3-712b74bd259d] Going to try to terminate instance {{(pid=127771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:05:35.675618 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-1d2bd32b-95c6-4164-b16d-015077f4925a tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d" status: 204 len: 0 microversion: 2.1 time: 0.321833 Sep 09 13:05:35.676143 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 476/945] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:05:35 2022] DELETE /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:05:35.684824 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-9f254274-db02-4bb3-9d36-34cc7f443013 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:35.686209 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-9f254274-db02-4bb3-9d36-34cc7f443013 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 8b44729a-0b11-45eb-a1c3-712b74bd259d] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:35.692304 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2ac063bd-ab4a-405b-96be-d6ae145520d7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:35.692994 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2ac063bd-ab4a-405b-96be-d6ae145520d7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:35.693265 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9f254274-db02-4bb3-9d36-34cc7f443013 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:35.693760 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9f254274-db02-4bb3-9d36-34cc7f443013 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:35.694198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9f254274-db02-4bb3-9d36-34cc7f443013 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:35.694954 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9f254274-db02-4bb3-9d36-34cc7f443013 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:35.695515 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9f254274-db02-4bb3-9d36-34cc7f443013 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:35.695973 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9f254274-db02-4bb3-9d36-34cc7f443013 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:35.699701 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ac063bd-ab4a-405b-96be-d6ae145520d7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:35.700188 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ac063bd-ab4a-405b-96be-d6ae145520d7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:35.700621 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ac063bd-ab4a-405b-96be-d6ae145520d7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:35.701318 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ac063bd-ab4a-405b-96be-d6ae145520d7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:35.701950 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ac063bd-ab4a-405b-96be-d6ae145520d7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:35.702376 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2ac063bd-ab4a-405b-96be-d6ae145520d7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:35.830057 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-9f254274-db02-4bb3-9d36-34cc7f443013 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:35.839006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-9f254274-db02-4bb3-9d36-34cc7f443013 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d" status: 200 len: 1513 microversion: 2.1 time: 0.158442 Sep 09 13:05:35.839612 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 470/946] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:35 2022] GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:35.846135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2ac063bd-ab4a-405b-96be-d6ae145520d7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:35.854026 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2ac063bd-ab4a-405b-96be-d6ae145520d7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1509 microversion: 2.1 time: 0.166098 Sep 09 13:05:35.854701 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 477/947] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:35 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:05:35.878060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-def33ac7-dfc1-41e0-802d-ea16ffd55114 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:05:35.878690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-def33ac7-dfc1-41e0-802d-ea16ffd55114 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:35.888063 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-def33ac7-dfc1-41e0-802d-ea16ffd55114 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:35.888558 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-def33ac7-dfc1-41e0-802d-ea16ffd55114 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:35.888996 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-def33ac7-dfc1-41e0-802d-ea16ffd55114 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:35.889693 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-def33ac7-dfc1-41e0-802d-ea16ffd55114 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:35.890156 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-def33ac7-dfc1-41e0-802d-ea16ffd55114 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:35.890608 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-def33ac7-dfc1-41e0-802d-ea16ffd55114 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:35.938707 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-def33ac7-dfc1-41e0-802d-ea16ffd55114 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127772) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 13:05:36.201422 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-def33ac7-dfc1-41e0-802d-ea16ffd55114 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "POST /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e/action" status: 202 len: 0 microversion: 2.1 time: 0.328360 Sep 09 13:05:36.202286 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 471/948] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 13:05:35 2022] POST /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:05:36.210653 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ad9d71cb-b1ba-47cb-bb43-5739dffd3db3 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:36.211271 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ad9d71cb-b1ba-47cb-bb43-5739dffd3db3 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:36.217177 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ad9d71cb-b1ba-47cb-bb43-5739dffd3db3 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:36.217676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ad9d71cb-b1ba-47cb-bb43-5739dffd3db3 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:36.218100 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ad9d71cb-b1ba-47cb-bb43-5739dffd3db3 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:36.218817 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ad9d71cb-b1ba-47cb-bb43-5739dffd3db3 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:36.219270 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ad9d71cb-b1ba-47cb-bb43-5739dffd3db3 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:36.219695 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ad9d71cb-b1ba-47cb-bb43-5739dffd3db3 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:36.352567 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ad9d71cb-b1ba-47cb-bb43-5739dffd3db3 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:36.356783 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:05:36.361510 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ad9d71cb-b1ba-47cb-bb43-5739dffd3db3 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1517 microversion: 2.1 time: 0.155034 Sep 09 13:05:36.366394 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 478/949] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:36 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:36.862931 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-146237c1-88e1-4913-b230-866bea5b06a4 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:36.863617 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-146237c1-88e1-4913-b230-866bea5b06a4 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 8b44729a-0b11-45eb-a1c3-712b74bd259d] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:36.869821 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-146237c1-88e1-4913-b230-866bea5b06a4 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:36.870298 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-146237c1-88e1-4913-b230-866bea5b06a4 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:36.870758 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-146237c1-88e1-4913-b230-866bea5b06a4 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:36.871442 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-146237c1-88e1-4913-b230-866bea5b06a4 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:36.871897 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-146237c1-88e1-4913-b230-866bea5b06a4 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:36.872315 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-146237c1-88e1-4913-b230-866bea5b06a4 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:37.007908 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-146237c1-88e1-4913-b230-866bea5b06a4 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:37.016185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-146237c1-88e1-4913-b230-866bea5b06a4 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d" status: 200 len: 1513 microversion: 2.1 time: 0.157901 Sep 09 13:05:37.016799 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 472/950] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:36 2022] GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:37.385003 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e76d6590-21ab-4d88-b5d5-c964382507d2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:37.385541 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-e76d6590-21ab-4d88-b5d5-c964382507d2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:37.392811 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e76d6590-21ab-4d88-b5d5-c964382507d2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:37.393299 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e76d6590-21ab-4d88-b5d5-c964382507d2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:37.393743 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e76d6590-21ab-4d88-b5d5-c964382507d2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:37.394442 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e76d6590-21ab-4d88-b5d5-c964382507d2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:37.394925 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e76d6590-21ab-4d88-b5d5-c964382507d2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:37.395351 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e76d6590-21ab-4d88-b5d5-c964382507d2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:37.537902 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e76d6590-21ab-4d88-b5d5-c964382507d2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:37.547189 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-e76d6590-21ab-4d88-b5d5-c964382507d2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1517 microversion: 2.1 time: 0.166229 Sep 09 13:05:37.552283 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 479/951] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:37 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:37.738683 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-e99373c6-0714-4b79-8090-c75de45503db req-198eeeed-a9e8-43e8-b12a-02c7fc19e437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10884cc0-9f01-425e-8d5f-9e0727a68b5e", "name": "network-vif-unplugged", "status": "completed", "tag": "b5735773-f9c8-4cb1-80c8-146eef0519fe"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:05:37.757355 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-e99373c6-0714-4b79-8090-c75de45503db req-198eeeed-a9e8-43e8-b12a-02c7fc19e437 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:37.758013 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-e99373c6-0714-4b79-8090-c75de45503db req-198eeeed-a9e8-43e8-b12a-02c7fc19e437 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:37.758660 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-e99373c6-0714-4b79-8090-c75de45503db req-198eeeed-a9e8-43e8-b12a-02c7fc19e437 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:37.777967 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.compute.server_external_events [req-e99373c6-0714-4b79-8090-c75de45503db req-198eeeed-a9e8-43e8-b12a-02c7fc19e437 service nova] Unable to find a host for instance 10884cc0-9f01-425e-8d5f-9e0727a68b5e. Dropping event network-vif-unplugged {{(pid=127772) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 13:05:37.779100 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-e99373c6-0714-4b79-8090-c75de45503db req-198eeeed-a9e8-43e8-b12a-02c7fc19e437 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.044405 Sep 09 13:05:37.784134 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 473/952] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 50 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 09 13:05:38.040150 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-5a47577b-ddda-417d-a99d-8938699a1b06 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:38.041165 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-5a47577b-ddda-417d-a99d-8938699a1b06 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 8b44729a-0b11-45eb-a1c3-712b74bd259d] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:38.047242 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a47577b-ddda-417d-a99d-8938699a1b06 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:38.047738 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a47577b-ddda-417d-a99d-8938699a1b06 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:38.048192 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a47577b-ddda-417d-a99d-8938699a1b06 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:38.048900 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a47577b-ddda-417d-a99d-8938699a1b06 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:38.049364 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a47577b-ddda-417d-a99d-8938699a1b06 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:38.049804 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5a47577b-ddda-417d-a99d-8938699a1b06 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:38.186041 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-5a47577b-ddda-417d-a99d-8938699a1b06 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:38.193886 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-5a47577b-ddda-417d-a99d-8938699a1b06 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d" status: 200 len: 1513 microversion: 2.1 time: 0.157739 Sep 09 13:05:38.194464 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 480/953] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:38 2022] GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:38.296888 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-4c84783a-d0b2-40f7-9406-9623a80ee7e6 req-3ffc2b3a-d117-4303-92ae-6d4ddd31c520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b44729a-0b11-45eb-a1c3-712b74bd259d", "name": "network-vif-deleted", "tag": "4296eb81-bba7-4d6c-abb4-18d7347a6a9b"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:05:38.310106 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-4c84783a-d0b2-40f7-9406-9623a80ee7e6 req-3ffc2b3a-d117-4303-92ae-6d4ddd31c520 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:38.317750 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-4c84783a-d0b2-40f7-9406-9623a80ee7e6 req-3ffc2b3a-d117-4303-92ae-6d4ddd31c520 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:38.317750 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-4c84783a-d0b2-40f7-9406-9623a80ee7e6 req-3ffc2b3a-d117-4303-92ae-6d4ddd31c520 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:38.317750 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:05:38.322646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-4c84783a-d0b2-40f7-9406-9623a80ee7e6 req-3ffc2b3a-d117-4303-92ae-6d4ddd31c520 service nova] Creating event network-vif-deleted:4296eb81-bba7-4d6c-abb4-18d7347a6a9b for instance 8b44729a-0b11-45eb-a1c3-712b74bd259d on hv-cinder-81322 Sep 09 13:05:38.327805 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-4c84783a-d0b2-40f7-9406-9623a80ee7e6 req-3ffc2b3a-d117-4303-92ae-6d4ddd31c520 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035250 Sep 09 13:05:38.328564 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 474/954] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:05:38.571059 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-18ebed4b-9cf0-4470-90db-100688cf58da tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:38.572393 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-18ebed4b-9cf0-4470-90db-100688cf58da tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:38.574577 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:05:38.579374 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-18ebed4b-9cf0-4470-90db-100688cf58da tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:38.579861 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-18ebed4b-9cf0-4470-90db-100688cf58da tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:38.580296 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-18ebed4b-9cf0-4470-90db-100688cf58da tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:38.581161 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-18ebed4b-9cf0-4470-90db-100688cf58da tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:38.581619 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-18ebed4b-9cf0-4470-90db-100688cf58da tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:38.582041 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-18ebed4b-9cf0-4470-90db-100688cf58da tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:38.733791 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-18ebed4b-9cf0-4470-90db-100688cf58da tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:38.741775 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-18ebed4b-9cf0-4470-90db-100688cf58da tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1519 microversion: 2.1 time: 0.174568 Sep 09 13:05:38.742343 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 481/955] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:38 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:39.220275 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-34108024-a408-4921-85d3-2cc9beb8a147 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:39.220975 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-34108024-a408-4921-85d3-2cc9beb8a147 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 8b44729a-0b11-45eb-a1c3-712b74bd259d] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:39.228382 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-34108024-a408-4921-85d3-2cc9beb8a147 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:39.228913 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-34108024-a408-4921-85d3-2cc9beb8a147 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:39.229349 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-34108024-a408-4921-85d3-2cc9beb8a147 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:39.230046 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-34108024-a408-4921-85d3-2cc9beb8a147 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:39.230507 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-34108024-a408-4921-85d3-2cc9beb8a147 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:39.230943 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-34108024-a408-4921-85d3-2cc9beb8a147 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:39.264741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-34108024-a408-4921-85d3-2cc9beb8a147 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:39.265222 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-34108024-a408-4921-85d3-2cc9beb8a147 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:39.265737 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-34108024-a408-4921-85d3-2cc9beb8a147 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:39.266186 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.objects.instance [None req-34108024-a408-4921-85d3-2cc9beb8a147 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lazy-loading 'fault' on Instance uuid 8b44729a-0b11-45eb-a1c3-712b74bd259d {{(pid=127772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:05:39.309461 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-34108024-a408-4921-85d3-2cc9beb8a147 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:39.317424 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-34108024-a408-4921-85d3-2cc9beb8a147 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d" status: 200 len: 1308 microversion: 2.1 time: 0.101556 Sep 09 13:05:39.318247 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 475/956] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:39 2022] GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:39.767193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-72ea75c2-153d-4250-a2c8-e1bea34e43c7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:39.768251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-72ea75c2-153d-4250-a2c8-e1bea34e43c7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:39.775916 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-72ea75c2-153d-4250-a2c8-e1bea34e43c7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:39.776496 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-72ea75c2-153d-4250-a2c8-e1bea34e43c7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:39.777989 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-72ea75c2-153d-4250-a2c8-e1bea34e43c7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:39.780215 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-72ea75c2-153d-4250-a2c8-e1bea34e43c7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:39.781826 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-72ea75c2-153d-4250-a2c8-e1bea34e43c7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:39.782270 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-72ea75c2-153d-4250-a2c8-e1bea34e43c7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:39.914453 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-72ea75c2-153d-4250-a2c8-e1bea34e43c7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:39.922851 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-72ea75c2-153d-4250-a2c8-e1bea34e43c7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1575 microversion: 2.1 time: 0.160665 Sep 09 13:05:39.923410 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 482/957] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:39 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:40.342757 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ee9fd0b5-2aa0-4413-ba3a-d5f133b5666d tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:40.343512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-ee9fd0b5-2aa0-4413-ba3a-d5f133b5666d tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 8b44729a-0b11-45eb-a1c3-712b74bd259d] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:40.351460 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ee9fd0b5-2aa0-4413-ba3a-d5f133b5666d tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:40.351954 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ee9fd0b5-2aa0-4413-ba3a-d5f133b5666d tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:40.352385 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ee9fd0b5-2aa0-4413-ba3a-d5f133b5666d tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:40.353116 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ee9fd0b5-2aa0-4413-ba3a-d5f133b5666d tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:40.354117 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ee9fd0b5-2aa0-4413-ba3a-d5f133b5666d tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:40.354561 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ee9fd0b5-2aa0-4413-ba3a-d5f133b5666d tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:40.370906 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-ee9fd0b5-2aa0-4413-ba3a-d5f133b5666d tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] HTTP exception thrown: Instance 8b44729a-0b11-45eb-a1c3-712b74bd259d could not be found. Sep 09 13:05:40.372482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ee9fd0b5-2aa0-4413-ba3a-d5f133b5666d tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Request method failure captured: Sep 09 13:05:40.372482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d HTTP/1.1 Sep 09 13:05:40.372482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 13:05:40.372482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 13:05:40.372482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 13:05:40.372482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 13:05:40.372482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 13:05:40.372482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 13:05:40.372482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 13:05:40.372482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 13:05:40.372482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGznkabAyzgAtXyb6yS1h1sbaN_fo8b6etClwgCyCNM4E8e21ruFoFviVSTD_9NFFeVjbcpIPAIqZEGNwuy1fAeWKR_4EV1kFDCDKbLyuTkqfui4CiARwjRURaZkU13wugos6cgUG3gm0VV4fXi5uNy0o-CqSj-5AG3-eeyJLfFNHolg Sep 09 13:05:40.372482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 13:05:40.372482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 13:05:40.372482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 13:05:40.372482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 13:05:40.372482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 13:05:40.372482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 13:05:40.372482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: 372ca5d37ce94b8fa267f2ee7a81789e Sep 09 13:05:40.372482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-VolumesSnapshotTestJSON-835679475 Sep 09 13:05:40.372482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 13:05:40.372482 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 13:05:40.373963 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/372ca5d37ce94b8fa267f2ee7a81789e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_372ca5d37ce94b8fa267f2ee7a81789e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/372ca5d37ce94b8fa267f2ee7a81789e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/372ca5d37ce94b8fa267f2ee7a81789e"}]}] Sep 09 13:05:40.373963 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-VolumesSnapshotTestJSON-835679475 Sep 09 13:05:40.373963 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: 372ca5d37ce94b8fa267f2ee7a81789e Sep 09 13:05:40.373963 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-835679475 Sep 09 13:05:40.373963 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-VolumesSnapshotTestJSON-835679475-project Sep 09 13:05:40.373963 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 13:05:40.373963 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 13:05:40.373963 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: c9ac7bf809174b6680a4eb5e088de614 Sep 09 13:05:40.373963 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-VolumesSnapshotTestJSON-835679475-project Sep 09 13:05:40.373963 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: > Sep 09 13:05:40.373963 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Instance 8b44729a-0b11-45eb-a1c3-712b74bd259d could not be found. Sep 09 13:05:40.373963 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'id': '8b44729a-0b11-45eb-a1c3-712b74bd259d'} Sep 09 13:05:40.374861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:05:40.374861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:05:40.374861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:05:40.374861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:05:40.374861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:05:40.374861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:05:40.374861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:05:40.374861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:05:40.374861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:05:40.374861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:05:40.374861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b44729a-0b11-45eb-a1c3-712b74bd259d could not be found. Sep 09 13:05:40.374861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:05:40.374861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:05:40.374861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:05:40.374861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:05:40.374861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:05:40.374861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:05:40.374861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:05:40.374861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:05:40.374861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:05:40.376185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:05:40.376185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:05:40.376185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:05:40.376185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:05:40.376185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:05:40.376185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:05:40.376185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:05:40.376185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b44729a-0b11-45eb-a1c3-712b74bd259d could not be found. Sep 09 13:05:40.376185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:05:40.376185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:05:40.376185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:05:40.376185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:05:40.376185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:05:40.376185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:05:40.376185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:05:40.376185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:05:40.376185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b44729a-0b11-45eb-a1c3-712b74bd259d could not be found. Sep 09 13:05:40.376185 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:05:40.377351 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ee9fd0b5-2aa0-4413-ba3a-d5f133b5666d tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Returning 404 to user: Instance 8b44729a-0b11-45eb-a1c3-712b74bd259d could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:05:40.377351 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-ee9fd0b5-2aa0-4413-ba3a-d5f133b5666d tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d" status: 404 len: 111 microversion: 2.1 time: 0.036417 Sep 09 13:05:40.377351 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 476/958] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:40 2022] GET /compute/v2.1/servers/8b44729a-0b11-45eb-a1c3-712b74bd259d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:05:40.945500 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8e416f7b-b864-4455-99ad-d7a5781174f9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:40.946215 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-8e416f7b-b864-4455-99ad-d7a5781174f9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:40.953665 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8e416f7b-b864-4455-99ad-d7a5781174f9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:40.954424 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8e416f7b-b864-4455-99ad-d7a5781174f9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:40.954914 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8e416f7b-b864-4455-99ad-d7a5781174f9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:40.955623 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8e416f7b-b864-4455-99ad-d7a5781174f9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:40.956088 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8e416f7b-b864-4455-99ad-d7a5781174f9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:40.956519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8e416f7b-b864-4455-99ad-d7a5781174f9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:41.090844 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-8e416f7b-b864-4455-99ad-d7a5781174f9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:41.098638 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-8e416f7b-b864-4455-99ad-d7a5781174f9 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1575 microversion: 2.1 time: 0.157098 Sep 09 13:05:41.099209 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 483/959] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:40 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:42.122576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-2b8d6b59-d40c-44e8-b1b6-8549076c6de8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:42.123103 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-2b8d6b59-d40c-44e8-b1b6-8549076c6de8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:42.129811 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2b8d6b59-d40c-44e8-b1b6-8549076c6de8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:42.130297 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2b8d6b59-d40c-44e8-b1b6-8549076c6de8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:42.130935 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2b8d6b59-d40c-44e8-b1b6-8549076c6de8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:42.131430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2b8d6b59-d40c-44e8-b1b6-8549076c6de8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:42.131877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2b8d6b59-d40c-44e8-b1b6-8549076c6de8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:42.132298 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2b8d6b59-d40c-44e8-b1b6-8549076c6de8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:42.289443 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-2b8d6b59-d40c-44e8-b1b6-8549076c6de8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:42.297333 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-2b8d6b59-d40c-44e8-b1b6-8549076c6de8 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1575 microversion: 2.1 time: 0.179239 Sep 09 13:05:42.297892 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 477/960] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:42 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:43.320483 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ad350aca-6fd3-467b-869b-54ee3f7f0174 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:43.321097 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ad350aca-6fd3-467b-869b-54ee3f7f0174 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:43.328063 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ad350aca-6fd3-467b-869b-54ee3f7f0174 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:43.328811 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ad350aca-6fd3-467b-869b-54ee3f7f0174 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:43.328969 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ad350aca-6fd3-467b-869b-54ee3f7f0174 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:43.329666 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ad350aca-6fd3-467b-869b-54ee3f7f0174 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:43.330120 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ad350aca-6fd3-467b-869b-54ee3f7f0174 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:43.330579 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ad350aca-6fd3-467b-869b-54ee3f7f0174 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:43.466516 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ad350aca-6fd3-467b-869b-54ee3f7f0174 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:43.474302 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ad350aca-6fd3-467b-869b-54ee3f7f0174 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1575 microversion: 2.1 time: 0.157692 Sep 09 13:05:43.474915 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 484/961] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:43 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:44.497853 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-37526962-8353-42ad-9855-423949b3ca49 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:44.498459 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-37526962-8353-42ad-9855-423949b3ca49 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:44.504811 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-37526962-8353-42ad-9855-423949b3ca49 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:44.505291 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-37526962-8353-42ad-9855-423949b3ca49 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:44.505722 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-37526962-8353-42ad-9855-423949b3ca49 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:44.506404 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-37526962-8353-42ad-9855-423949b3ca49 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:44.506900 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-37526962-8353-42ad-9855-423949b3ca49 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:44.507324 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-37526962-8353-42ad-9855-423949b3ca49 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:44.637317 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-37526962-8353-42ad-9855-423949b3ca49 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:44.644987 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-37526962-8353-42ad-9855-423949b3ca49 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1575 microversion: 2.1 time: 0.151097 Sep 09 13:05:44.645553 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 478/962] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:44 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:45.669034 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-cdf5b68f-cc91-4ce4-a421-664444ff14cd tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:45.669565 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-cdf5b68f-cc91-4ce4-a421-664444ff14cd tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:45.676046 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cdf5b68f-cc91-4ce4-a421-664444ff14cd tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:45.676535 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cdf5b68f-cc91-4ce4-a421-664444ff14cd tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:45.676977 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cdf5b68f-cc91-4ce4-a421-664444ff14cd tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:45.677673 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cdf5b68f-cc91-4ce4-a421-664444ff14cd tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:45.678128 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cdf5b68f-cc91-4ce4-a421-664444ff14cd tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:45.678584 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-cdf5b68f-cc91-4ce4-a421-664444ff14cd tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:45.812648 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-cdf5b68f-cc91-4ce4-a421-664444ff14cd tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:45.820370 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-cdf5b68f-cc91-4ce4-a421-664444ff14cd tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1575 microversion: 2.1 time: 0.156272 Sep 09 13:05:45.820934 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 485/963] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:45 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:46.845412 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-edef4faf-b466-43ff-8544-cb1a3765b67e tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:46.845935 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-edef4faf-b466-43ff-8544-cb1a3765b67e tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:46.848477 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:05:46.853132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-edef4faf-b466-43ff-8544-cb1a3765b67e tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:46.853618 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-edef4faf-b466-43ff-8544-cb1a3765b67e tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:46.854576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-edef4faf-b466-43ff-8544-cb1a3765b67e tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:46.855282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-edef4faf-b466-43ff-8544-cb1a3765b67e tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:46.855783 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-edef4faf-b466-43ff-8544-cb1a3765b67e tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:46.856213 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-edef4faf-b466-43ff-8544-cb1a3765b67e tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:46.989759 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-edef4faf-b466-43ff-8544-cb1a3765b67e tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:46.997662 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-edef4faf-b466-43ff-8544-cb1a3765b67e tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1575 microversion: 2.1 time: 0.156297 Sep 09 13:05:46.998204 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 479/964] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:46 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:48.021567 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-9a241e6c-c099-45e0-a99d-67521155b780 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:48.022187 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-9a241e6c-c099-45e0-a99d-67521155b780 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:48.029246 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9a241e6c-c099-45e0-a99d-67521155b780 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:48.029720 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9a241e6c-c099-45e0-a99d-67521155b780 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:48.030166 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9a241e6c-c099-45e0-a99d-67521155b780 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:48.030901 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9a241e6c-c099-45e0-a99d-67521155b780 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:48.031360 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9a241e6c-c099-45e0-a99d-67521155b780 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:48.031790 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9a241e6c-c099-45e0-a99d-67521155b780 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:48.165279 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-9a241e6c-c099-45e0-a99d-67521155b780 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:48.174069 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-9a241e6c-c099-45e0-a99d-67521155b780 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1575 microversion: 2.1 time: 0.156431 Sep 09 13:05:48.174668 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 486/965] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:48 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:49.196453 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-108ab371-cdee-40d2-9540-41ef842fb0f2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:49.197061 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-108ab371-cdee-40d2-9540-41ef842fb0f2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:49.203904 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-108ab371-cdee-40d2-9540-41ef842fb0f2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:49.204382 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-108ab371-cdee-40d2-9540-41ef842fb0f2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:49.204823 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-108ab371-cdee-40d2-9540-41ef842fb0f2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:49.205510 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-108ab371-cdee-40d2-9540-41ef842fb0f2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:49.205960 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-108ab371-cdee-40d2-9540-41ef842fb0f2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:49.206381 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-108ab371-cdee-40d2-9540-41ef842fb0f2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:49.339753 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-108ab371-cdee-40d2-9540-41ef842fb0f2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:49.347512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-108ab371-cdee-40d2-9540-41ef842fb0f2 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1575 microversion: 2.1 time: 0.154947 Sep 09 13:05:49.348074 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 480/966] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:49 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:50.165104 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-b1b5440a-d937-472c-bf22-f213fc9754ef tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:50.165603 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-b1b5440a-d937-472c-bf22-f213fc9754ef tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:50.172169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b1b5440a-d937-472c-bf22-f213fc9754ef tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:50.173415 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b1b5440a-d937-472c-bf22-f213fc9754ef tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:50.173415 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b1b5440a-d937-472c-bf22-f213fc9754ef tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:50.173777 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b1b5440a-d937-472c-bf22-f213fc9754ef tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:50.174243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b1b5440a-d937-472c-bf22-f213fc9754ef tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:50.174710 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b1b5440a-d937-472c-bf22-f213fc9754ef tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:50.255796 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.objects.instance [None req-b1b5440a-d937-472c-bf22-f213fc9754ef tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lazy-loading 'services' on Instance uuid f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 {{(pid=127771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:05:50.371864 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-575bea14-1026-4314-8563-fff74ea0c86b tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:50.372469 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-575bea14-1026-4314-8563-fff74ea0c86b tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:50.379011 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-575bea14-1026-4314-8563-fff74ea0c86b tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:50.379408 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-575bea14-1026-4314-8563-fff74ea0c86b tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:50.379941 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-575bea14-1026-4314-8563-fff74ea0c86b tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:50.380643 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-575bea14-1026-4314-8563-fff74ea0c86b tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:50.381164 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-575bea14-1026-4314-8563-fff74ea0c86b tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:50.381595 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-575bea14-1026-4314-8563-fff74ea0c86b tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:50.470778 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-b1b5440a-d937-472c-bf22-f213fc9754ef tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0/os-volume_attachments/c6bcc61d-049e-4934-acfd-0a4352b2d1d8" status: 202 len: 0 microversion: 2.1 time: 0.309496 Sep 09 13:05:50.471382 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 487/967] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 13:05:50 2022] DELETE /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0/os-volume_attachments/c6bcc61d-049e-4934-acfd-0a4352b2d1d8 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:05:50.514981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-575bea14-1026-4314-8563-fff74ea0c86b tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:50.524409 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-575bea14-1026-4314-8563-fff74ea0c86b tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1575 microversion: 2.1 time: 0.156851 Sep 09 13:05:50.530324 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 481/968] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:50 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:05:50.850234 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-c4b25852-49e1-4789-8cc7-3262f8ee3149 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1404476593", "imageRef": "355bded2-2225-44b2-af86-f9e1861d05ff", "flavorRef": "452", "networks": [{"uuid": "a421270d-c142-4dc1-a03b-7a17f0c5c3b6"}]}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:05:50.902616 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.network.neutron [None req-c4b25852-49e1-4789-8cc7-3262f8ee3149 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] validate_networks() for [('a421270d-c142-4dc1-a03b-7a17f0c5c3b6', None, None, None, None, None)] {{(pid=127771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:05:51.253782 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-c4b25852-49e1-4789-8cc7-3262f8ee3149 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Flavor limits 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:05:51.254359 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-c4b25852-49e1-4789-8cc7-3262f8ee3149 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Image limits 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:05:51.254726 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-c4b25852-49e1-4789-8cc7-3262f8ee3149 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Flavor pref 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:05:51.255141 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-c4b25852-49e1-4789-8cc7-3262f8ee3149 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Image pref 0:0:0 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:05:51.255618 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.virt.hardware [None req-c4b25852-49e1-4789-8cc7-3262f8ee3149 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:05:51.264359 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c4b25852-49e1-4789-8cc7-3262f8ee3149 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:51.264838 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c4b25852-49e1-4789-8cc7-3262f8ee3149 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:51.266654 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c4b25852-49e1-4789-8cc7-3262f8ee3149 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:51.266654 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c4b25852-49e1-4789-8cc7-3262f8ee3149 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:51.266654 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c4b25852-49e1-4789-8cc7-3262f8ee3149 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:51.266981 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c4b25852-49e1-4789-8cc7-3262f8ee3149 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:51.283769 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-c4b25852-49e1-4789-8cc7-3262f8ee3149 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Getting quotas for project 372ca5d37ce94b8fa267f2ee7a81789e. Resources: {'instances', 'cores', 'ram'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:05:51.287752 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-c4b25852-49e1-4789-8cc7-3262f8ee3149 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Getting quotas for user c9ac7bf809174b6680a4eb5e088de614 and project 372ca5d37ce94b8fa267f2ee7a81789e. Resources: {'instances', 'cores', 'ram'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:05:51.299757 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-c4b25852-49e1-4789-8cc7-3262f8ee3149 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Going to run 1 instances... {{(pid=127771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:05:51.302411 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-c4b25852-49e1-4789-8cc7-3262f8ee3149 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 06aed0fe-2740-4d1a-a8ff-7e12703b7906] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='355bded2-2225-44b2-af86-f9e1861d05ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:05:51.428211 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-c4b25852-49e1-4789-8cc7-3262f8ee3149 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.582008 Sep 09 13:05:51.428963 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 488/969] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 13:05:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:05:51.440598 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-b6019528-1ca6-4048-94f5-75206a5d8b6c tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:51.441208 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-b6019528-1ca6-4048-94f5-75206a5d8b6c tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 06aed0fe-2740-4d1a-a8ff-7e12703b7906] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:51.504380 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-b6019528-1ca6-4048-94f5-75206a5d8b6c tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:51.511525 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-b6019528-1ca6-4048-94f5-75206a5d8b6c tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906" status: 200 len: 1219 microversion: 2.1 time: 0.074828 Sep 09 13:05:51.512099 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 482/970] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:51 2022] GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:51.548959 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0dfd88a7-77a7-4c2a-8d3d-be1069231a52 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:51.549892 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-0dfd88a7-77a7-4c2a-8d3d-be1069231a52 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:51.559305 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0dfd88a7-77a7-4c2a-8d3d-be1069231a52 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:51.559925 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0dfd88a7-77a7-4c2a-8d3d-be1069231a52 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:51.560374 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0dfd88a7-77a7-4c2a-8d3d-be1069231a52 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:51.561175 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0dfd88a7-77a7-4c2a-8d3d-be1069231a52 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:51.561639 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0dfd88a7-77a7-4c2a-8d3d-be1069231a52 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:51.562260 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0dfd88a7-77a7-4c2a-8d3d-be1069231a52 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:51.600093 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7137bff3-04d2-49b4-811a-fbc3bc108841 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:05:51.608507 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7137bff3-04d2-49b4-811a-fbc3bc108841 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:51.609104 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7137bff3-04d2-49b4-811a-fbc3bc108841 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:51.609620 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7137bff3-04d2-49b4-811a-fbc3bc108841 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:51.634382 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7137bff3-04d2-49b4-811a-fbc3bc108841 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Going to try to stop instance {{(pid=127772) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 13:05:51.701828 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-0dfd88a7-77a7-4c2a-8d3d-be1069231a52 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:51.709988 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0dfd88a7-77a7-4c2a-8d3d-be1069231a52 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1575 microversion: 2.1 time: 0.165940 Sep 09 13:05:51.711007 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 489/971] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:51 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:51.815961 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7137bff3-04d2-49b4-811a-fbc3bc108841 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "POST /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0/action" status: 202 len: 0 microversion: 2.1 time: 0.219533 Sep 09 13:05:51.816664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 483/972] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 13:05:51 2022] POST /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:05:51.826910 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-f12d6320-b018-4132-af8d-74276c23fa9e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:51.827559 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-f12d6320-b018-4132-af8d-74276c23fa9e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:51.833658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f12d6320-b018-4132-af8d-74276c23fa9e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:51.834144 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f12d6320-b018-4132-af8d-74276c23fa9e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:51.834597 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f12d6320-b018-4132-af8d-74276c23fa9e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:51.835285 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f12d6320-b018-4132-af8d-74276c23fa9e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:51.835738 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f12d6320-b018-4132-af8d-74276c23fa9e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:51.836159 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f12d6320-b018-4132-af8d-74276c23fa9e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:51.975680 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-f12d6320-b018-4132-af8d-74276c23fa9e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:51.985571 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-f12d6320-b018-4132-af8d-74276c23fa9e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1678 microversion: 2.1 time: 0.162698 Sep 09 13:05:51.990755 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 490/973] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:51 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:52.535445 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-cb3a9deb-5df0-4738-aec1-c6eb510402cf tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:52.536174 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-cb3a9deb-5df0-4738-aec1-c6eb510402cf tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 06aed0fe-2740-4d1a-a8ff-7e12703b7906] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:52.543143 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-cb3a9deb-5df0-4738-aec1-c6eb510402cf tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:52.543658 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-cb3a9deb-5df0-4738-aec1-c6eb510402cf tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:52.544095 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-cb3a9deb-5df0-4738-aec1-c6eb510402cf tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:52.544795 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-cb3a9deb-5df0-4738-aec1-c6eb510402cf tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:52.545248 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-cb3a9deb-5df0-4738-aec1-c6eb510402cf tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:52.545670 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-cb3a9deb-5df0-4738-aec1-c6eb510402cf tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:52.610779 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-cb3a9deb-5df0-4738-aec1-c6eb510402cf tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:52.619676 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-cb3a9deb-5df0-4738-aec1-c6eb510402cf tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906" status: 200 len: 1215 microversion: 2.1 time: 0.088913 Sep 09 13:05:52.620414 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 484/974] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:52 2022] GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906 => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:52.733373 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-90e447b9-5639-43a0-9d54-4208dc8ad0d0 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:52.734126 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-90e447b9-5639-43a0-9d54-4208dc8ad0d0 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:52.740631 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-90e447b9-5639-43a0-9d54-4208dc8ad0d0 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:52.741114 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-90e447b9-5639-43a0-9d54-4208dc8ad0d0 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:52.741579 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-90e447b9-5639-43a0-9d54-4208dc8ad0d0 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:52.742265 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-90e447b9-5639-43a0-9d54-4208dc8ad0d0 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:52.742745 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-90e447b9-5639-43a0-9d54-4208dc8ad0d0 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:52.743169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-90e447b9-5639-43a0-9d54-4208dc8ad0d0 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:52.878404 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-90e447b9-5639-43a0-9d54-4208dc8ad0d0 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:52.887226 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-90e447b9-5639-43a0-9d54-4208dc8ad0d0 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1575 microversion: 2.1 time: 0.157967 Sep 09 13:05:52.887797 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 491/975] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:52 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:53.008272 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-3bf28f2b-7601-4f92-b6e3-277c17a689fb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:53.008889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-3bf28f2b-7601-4f92-b6e3-277c17a689fb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:53.015306 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3bf28f2b-7601-4f92-b6e3-277c17a689fb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:53.015793 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3bf28f2b-7601-4f92-b6e3-277c17a689fb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:53.016228 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3bf28f2b-7601-4f92-b6e3-277c17a689fb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:53.016916 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3bf28f2b-7601-4f92-b6e3-277c17a689fb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:53.017389 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3bf28f2b-7601-4f92-b6e3-277c17a689fb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:53.017796 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-3bf28f2b-7601-4f92-b6e3-277c17a689fb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:53.149126 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-3bf28f2b-7601-4f92-b6e3-277c17a689fb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:53.157668 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-3bf28f2b-7601-4f92-b6e3-277c17a689fb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1678 microversion: 2.1 time: 0.153230 Sep 09 13:05:53.158241 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 485/976] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:53 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:53.647848 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-dafa091f-21c8-41fb-88d0-e4fa476c9d1f tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:53.648557 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-dafa091f-21c8-41fb-88d0-e4fa476c9d1f tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 06aed0fe-2740-4d1a-a8ff-7e12703b7906] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:53.655991 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dafa091f-21c8-41fb-88d0-e4fa476c9d1f tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:53.659015 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dafa091f-21c8-41fb-88d0-e4fa476c9d1f tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:53.659015 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dafa091f-21c8-41fb-88d0-e4fa476c9d1f tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:53.659015 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dafa091f-21c8-41fb-88d0-e4fa476c9d1f tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:53.659015 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dafa091f-21c8-41fb-88d0-e4fa476c9d1f tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:53.659397 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-dafa091f-21c8-41fb-88d0-e4fa476c9d1f tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:53.722315 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-dafa091f-21c8-41fb-88d0-e4fa476c9d1f tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:53.730122 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-dafa091f-21c8-41fb-88d0-e4fa476c9d1f tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906" status: 200 len: 1279 microversion: 2.1 time: 0.086157 Sep 09 13:05:53.730720 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 492/977] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:53 2022] GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906 => generated 1279 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:53.912328 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c60a467e-7486-4863-9d12-39ecdd36b070 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:53.912949 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-c60a467e-7486-4863-9d12-39ecdd36b070 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:53.920352 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c60a467e-7486-4863-9d12-39ecdd36b070 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:53.928125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c60a467e-7486-4863-9d12-39ecdd36b070 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:53.928125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c60a467e-7486-4863-9d12-39ecdd36b070 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:53.928125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c60a467e-7486-4863-9d12-39ecdd36b070 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:53.928125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c60a467e-7486-4863-9d12-39ecdd36b070 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:53.928806 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c60a467e-7486-4863-9d12-39ecdd36b070 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:54.040207 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-1e80da5b-c904-4d5b-80cc-69cbf5e7f20e req-78ddd3c5-13d7-4fc1-b7e5-7db6423eb479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10884cc0-9f01-425e-8d5f-9e0727a68b5e", "name": "network-vif-plugged", "status": "completed", "tag": "b5735773-f9c8-4cb1-80c8-146eef0519fe"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:05:54.050789 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-1e80da5b-c904-4d5b-80cc-69cbf5e7f20e req-78ddd3c5-13d7-4fc1-b7e5-7db6423eb479 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:54.051284 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-1e80da5b-c904-4d5b-80cc-69cbf5e7f20e req-78ddd3c5-13d7-4fc1-b7e5-7db6423eb479 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:54.051736 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-1e80da5b-c904-4d5b-80cc-69cbf5e7f20e req-78ddd3c5-13d7-4fc1-b7e5-7db6423eb479 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:54.064417 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-1e80da5b-c904-4d5b-80cc-69cbf5e7f20e req-78ddd3c5-13d7-4fc1-b7e5-7db6423eb479 service nova] Creating event network-vif-plugged:b5735773-f9c8-4cb1-80c8-146eef0519fe for instance 10884cc0-9f01-425e-8d5f-9e0727a68b5e on hv-cinder-81322 Sep 09 13:05:54.069556 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-1e80da5b-c904-4d5b-80cc-69cbf5e7f20e req-78ddd3c5-13d7-4fc1-b7e5-7db6423eb479 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033348 Sep 09 13:05:54.070319 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 493/978] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:05:54.178248 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c60a467e-7486-4863-9d12-39ecdd36b070 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:54.183609 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-05616dd4-22b3-4cf8-9043-8ff16520239b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:54.184319 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-05616dd4-22b3-4cf8-9043-8ff16520239b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:54.190732 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-c60a467e-7486-4863-9d12-39ecdd36b070 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1575 microversion: 2.1 time: 0.282162 Sep 09 13:05:54.192074 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 486/979] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:53 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1575 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:54.198269 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-05616dd4-22b3-4cf8-9043-8ff16520239b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:54.199670 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-05616dd4-22b3-4cf8-9043-8ff16520239b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:54.200127 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-05616dd4-22b3-4cf8-9043-8ff16520239b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:54.201224 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-05616dd4-22b3-4cf8-9043-8ff16520239b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:54.202424 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-05616dd4-22b3-4cf8-9043-8ff16520239b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:54.209053 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-05616dd4-22b3-4cf8-9043-8ff16520239b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:54.346497 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-05616dd4-22b3-4cf8-9043-8ff16520239b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:54.355626 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-05616dd4-22b3-4cf8-9043-8ff16520239b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1678 microversion: 2.1 time: 0.177003 Sep 09 13:05:54.356221 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 494/980] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:54 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:05:54.753094 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-1be6b542-03f9-4e17-8265-2fcbc3d55374 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:54.753747 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-1be6b542-03f9-4e17-8265-2fcbc3d55374 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 06aed0fe-2740-4d1a-a8ff-7e12703b7906] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:54.759839 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1be6b542-03f9-4e17-8265-2fcbc3d55374 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:54.760535 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1be6b542-03f9-4e17-8265-2fcbc3d55374 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:54.760977 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1be6b542-03f9-4e17-8265-2fcbc3d55374 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:54.761676 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1be6b542-03f9-4e17-8265-2fcbc3d55374 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:54.762135 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1be6b542-03f9-4e17-8265-2fcbc3d55374 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:54.762587 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1be6b542-03f9-4e17-8265-2fcbc3d55374 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:54.999330 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-1be6b542-03f9-4e17-8265-2fcbc3d55374 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:55.007334 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-1be6b542-03f9-4e17-8265-2fcbc3d55374 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906" status: 200 len: 1319 microversion: 2.1 time: 0.258231 Sep 09 13:05:55.007907 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 487/981] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:54 2022] GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:55.215445 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-968d4684-1a2a-445f-9422-acf8edfe8677 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:55.216061 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-968d4684-1a2a-445f-9422-acf8edfe8677 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:55.222429 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-968d4684-1a2a-445f-9422-acf8edfe8677 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:55.222940 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-968d4684-1a2a-445f-9422-acf8edfe8677 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:55.223375 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-968d4684-1a2a-445f-9422-acf8edfe8677 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:55.224071 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-968d4684-1a2a-445f-9422-acf8edfe8677 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:55.224519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-968d4684-1a2a-445f-9422-acf8edfe8677 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:55.224939 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-968d4684-1a2a-445f-9422-acf8edfe8677 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:55.365094 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-968d4684-1a2a-445f-9422-acf8edfe8677 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:55.373980 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-968d4684-1a2a-445f-9422-acf8edfe8677 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1575 microversion: 2.1 time: 0.162550 Sep 09 13:05:55.374984 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 495/982] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:55 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:55.379908 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-d85bfdb6-6301-4680-85ce-c9689b8ce05f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:55.380531 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-d85bfdb6-6301-4680-85ce-c9689b8ce05f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:55.386905 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d85bfdb6-6301-4680-85ce-c9689b8ce05f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:55.387623 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d85bfdb6-6301-4680-85ce-c9689b8ce05f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:55.388251 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d85bfdb6-6301-4680-85ce-c9689b8ce05f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:55.389155 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d85bfdb6-6301-4680-85ce-c9689b8ce05f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:55.389633 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d85bfdb6-6301-4680-85ce-c9689b8ce05f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:55.390067 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d85bfdb6-6301-4680-85ce-c9689b8ce05f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:55.580497 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-d85bfdb6-6301-4680-85ce-c9689b8ce05f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:55.589371 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-d85bfdb6-6301-4680-85ce-c9689b8ce05f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1678 microversion: 2.1 time: 0.213362 Sep 09 13:05:55.590035 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 488/983] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:55 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1678 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:55.683662 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-9b68e809-447a-44df-b2b9-bf705df200e2 req-fc45cb69-d7eb-4b70-bf4e-03f6d024c87a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06aed0fe-2740-4d1a-a8ff-7e12703b7906", "tag": "ad32fe5c-fe69-4514-80dc-5be0d7fcf55a"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:05:55.695102 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-9b68e809-447a-44df-b2b9-bf705df200e2 req-fc45cb69-d7eb-4b70-bf4e-03f6d024c87a service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:55.695586 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-9b68e809-447a-44df-b2b9-bf705df200e2 req-fc45cb69-d7eb-4b70-bf4e-03f6d024c87a service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:55.696019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-9b68e809-447a-44df-b2b9-bf705df200e2 req-fc45cb69-d7eb-4b70-bf4e-03f6d024c87a service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:55.700760 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:05:55.708042 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-9b68e809-447a-44df-b2b9-bf705df200e2 req-fc45cb69-d7eb-4b70-bf4e-03f6d024c87a service nova] Creating event network-changed:ad32fe5c-fe69-4514-80dc-5be0d7fcf55a for instance 06aed0fe-2740-4d1a-a8ff-7e12703b7906 on hv-cinder-81322 Sep 09 13:05:55.714217 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-9b68e809-447a-44df-b2b9-bf705df200e2 req-fc45cb69-d7eb-4b70-bf4e-03f6d024c87a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033800 Sep 09 13:05:55.714736 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 496/984] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:05:56.031655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c7abd97e-6708-402b-bc47-d3b7a0f8e17a tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:56.032284 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-c7abd97e-6708-402b-bc47-d3b7a0f8e17a tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 06aed0fe-2740-4d1a-a8ff-7e12703b7906] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:56.038797 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c7abd97e-6708-402b-bc47-d3b7a0f8e17a tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:56.041503 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c7abd97e-6708-402b-bc47-d3b7a0f8e17a tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:56.041503 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c7abd97e-6708-402b-bc47-d3b7a0f8e17a tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:56.041503 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c7abd97e-6708-402b-bc47-d3b7a0f8e17a tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:56.041503 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c7abd97e-6708-402b-bc47-d3b7a0f8e17a tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:56.042221 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c7abd97e-6708-402b-bc47-d3b7a0f8e17a tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:56.261527 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c7abd97e-6708-402b-bc47-d3b7a0f8e17a tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:56.269363 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-c7abd97e-6708-402b-bc47-d3b7a0f8e17a tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906" status: 200 len: 1319 microversion: 2.1 time: 0.241670 Sep 09 13:05:56.270518 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 489/985] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:56 2022] GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:56.399863 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0530a753-df46-4dca-a61e-3ceaa743b2f1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:56.400720 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-0530a753-df46-4dca-a61e-3ceaa743b2f1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:56.408703 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0530a753-df46-4dca-a61e-3ceaa743b2f1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:56.415990 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0530a753-df46-4dca-a61e-3ceaa743b2f1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:56.415990 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0530a753-df46-4dca-a61e-3ceaa743b2f1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:56.415990 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0530a753-df46-4dca-a61e-3ceaa743b2f1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:56.415990 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0530a753-df46-4dca-a61e-3ceaa743b2f1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:56.417066 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0530a753-df46-4dca-a61e-3ceaa743b2f1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:56.547271 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-0530a753-df46-4dca-a61e-3ceaa743b2f1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:56.555189 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0530a753-df46-4dca-a61e-3ceaa743b2f1 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1562 microversion: 2.1 time: 0.159873 Sep 09 13:05:56.555763 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 497/986] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:56 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:56.613282 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-1e53d9b8-458a-4159-8028-efc1a1fc2ed1 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:56.614040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-1e53d9b8-458a-4159-8028-efc1a1fc2ed1 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:56.620622 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1e53d9b8-458a-4159-8028-efc1a1fc2ed1 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:56.621112 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1e53d9b8-458a-4159-8028-efc1a1fc2ed1 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:56.621549 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1e53d9b8-458a-4159-8028-efc1a1fc2ed1 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:56.622251 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1e53d9b8-458a-4159-8028-efc1a1fc2ed1 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:56.622734 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1e53d9b8-458a-4159-8028-efc1a1fc2ed1 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:56.623161 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1e53d9b8-458a-4159-8028-efc1a1fc2ed1 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:56.824672 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-1e53d9b8-458a-4159-8028-efc1a1fc2ed1 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:56.832512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-1e53d9b8-458a-4159-8028-efc1a1fc2ed1 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1678 microversion: 2.1 time: 0.223219 Sep 09 13:05:56.833093 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 490/987] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:56 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1678 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:57.292850 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e08abe27-6ef3-45e2-8363-a32f68f25bc7 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:57.293486 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-e08abe27-6ef3-45e2-8363-a32f68f25bc7 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 06aed0fe-2740-4d1a-a8ff-7e12703b7906] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:57.299441 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e08abe27-6ef3-45e2-8363-a32f68f25bc7 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:57.299924 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e08abe27-6ef3-45e2-8363-a32f68f25bc7 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:57.300358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e08abe27-6ef3-45e2-8363-a32f68f25bc7 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:57.301092 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e08abe27-6ef3-45e2-8363-a32f68f25bc7 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:57.301541 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e08abe27-6ef3-45e2-8363-a32f68f25bc7 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:57.301965 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e08abe27-6ef3-45e2-8363-a32f68f25bc7 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:57.434626 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-e08abe27-6ef3-45e2-8363-a32f68f25bc7 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:57.442440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-e08abe27-6ef3-45e2-8363-a32f68f25bc7 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906" status: 200 len: 1319 microversion: 2.1 time: 0.154023 Sep 09 13:05:57.443028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 498/988] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:57 2022] GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:57.857910 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-8be90049-84eb-4e09-bb90-0ad0eea9a597 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:57.858569 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-8be90049-84eb-4e09-bb90-0ad0eea9a597 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:57.865070 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8be90049-84eb-4e09-bb90-0ad0eea9a597 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:57.865541 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8be90049-84eb-4e09-bb90-0ad0eea9a597 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:57.865980 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8be90049-84eb-4e09-bb90-0ad0eea9a597 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:57.866698 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8be90049-84eb-4e09-bb90-0ad0eea9a597 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:57.867157 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8be90049-84eb-4e09-bb90-0ad0eea9a597 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:57.867582 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8be90049-84eb-4e09-bb90-0ad0eea9a597 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:58.000730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-8be90049-84eb-4e09-bb90-0ad0eea9a597 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:58.004293 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:05:58.008845 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-8be90049-84eb-4e09-bb90-0ad0eea9a597 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1678 microversion: 2.1 time: 0.155899 Sep 09 13:05:58.013353 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 491/989] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:57 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:58.465098 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-457682ef-ef0e-402c-80ee-620ace0da780 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:58.465741 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-457682ef-ef0e-402c-80ee-620ace0da780 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 06aed0fe-2740-4d1a-a8ff-7e12703b7906] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:58.472198 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-457682ef-ef0e-402c-80ee-620ace0da780 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:58.472682 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-457682ef-ef0e-402c-80ee-620ace0da780 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:58.473120 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-457682ef-ef0e-402c-80ee-620ace0da780 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:58.473820 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-457682ef-ef0e-402c-80ee-620ace0da780 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:58.474283 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-457682ef-ef0e-402c-80ee-620ace0da780 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:58.474739 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-457682ef-ef0e-402c-80ee-620ace0da780 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:58.603934 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-457682ef-ef0e-402c-80ee-620ace0da780 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:58.611593 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-457682ef-ef0e-402c-80ee-620ace0da780 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906" status: 200 len: 1319 microversion: 2.1 time: 0.150413 Sep 09 13:05:58.612164 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 499/990] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:58 2022] GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:59.033410 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-9694dd7c-584e-44fc-b086-2ab226809061 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:59.034027 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-9694dd7c-584e-44fc-b086-2ab226809061 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:59.040717 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9694dd7c-584e-44fc-b086-2ab226809061 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:59.042434 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9694dd7c-584e-44fc-b086-2ab226809061 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:59.042904 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9694dd7c-584e-44fc-b086-2ab226809061 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:59.043603 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9694dd7c-584e-44fc-b086-2ab226809061 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:59.044063 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9694dd7c-584e-44fc-b086-2ab226809061 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:59.044491 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9694dd7c-584e-44fc-b086-2ab226809061 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:59.173796 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-9694dd7c-584e-44fc-b086-2ab226809061 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:59.181557 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-9694dd7c-584e-44fc-b086-2ab226809061 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1678 microversion: 2.1 time: 0.152374 Sep 09 13:05:59.182260 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 492/991] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:59 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:05:59.635274 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-781d4f67-8de9-4983-b9e3-c88d11c47f15 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:05:59.635939 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-781d4f67-8de9-4983-b9e3-c88d11c47f15 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 06aed0fe-2740-4d1a-a8ff-7e12703b7906] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:05:59.642504 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-781d4f67-8de9-4983-b9e3-c88d11c47f15 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:59.643002 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-781d4f67-8de9-4983-b9e3-c88d11c47f15 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:59.643441 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-781d4f67-8de9-4983-b9e3-c88d11c47f15 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:59.644140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-781d4f67-8de9-4983-b9e3-c88d11c47f15 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:05:59.644600 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-781d4f67-8de9-4983-b9e3-c88d11c47f15 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:05:59.645027 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-781d4f67-8de9-4983-b9e3-c88d11c47f15 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:05:59.777733 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-781d4f67-8de9-4983-b9e3-c88d11c47f15 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:05:59.785287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-781d4f67-8de9-4983-b9e3-c88d11c47f15 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906" status: 200 len: 1319 microversion: 2.1 time: 0.154730 Sep 09 13:05:59.785844 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 500/992] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:05:59 2022] GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:00.204996 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-c66da854-379f-4fad-94e0-bfe267161ffe tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:00.206231 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-c66da854-379f-4fad-94e0-bfe267161ffe tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:00.213045 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c66da854-379f-4fad-94e0-bfe267161ffe tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:00.213541 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c66da854-379f-4fad-94e0-bfe267161ffe tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:00.213982 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c66da854-379f-4fad-94e0-bfe267161ffe tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:00.214703 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c66da854-379f-4fad-94e0-bfe267161ffe tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:00.215254 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c66da854-379f-4fad-94e0-bfe267161ffe tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:00.215684 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-c66da854-379f-4fad-94e0-bfe267161ffe tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:00.347403 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-c66da854-379f-4fad-94e0-bfe267161ffe tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:00.356313 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-c66da854-379f-4fad-94e0-bfe267161ffe tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1678 microversion: 2.1 time: 0.155290 Sep 09 13:06:00.356880 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 493/993] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:00 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:00.808638 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-50bd1ce1-9261-4037-9e02-3f1effaa1052 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:00.809286 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-50bd1ce1-9261-4037-9e02-3f1effaa1052 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 06aed0fe-2740-4d1a-a8ff-7e12703b7906] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:00.815789 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-50bd1ce1-9261-4037-9e02-3f1effaa1052 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:00.816276 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-50bd1ce1-9261-4037-9e02-3f1effaa1052 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:00.816718 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-50bd1ce1-9261-4037-9e02-3f1effaa1052 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:00.817411 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-50bd1ce1-9261-4037-9e02-3f1effaa1052 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:00.817869 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-50bd1ce1-9261-4037-9e02-3f1effaa1052 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:00.818329 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-50bd1ce1-9261-4037-9e02-3f1effaa1052 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:00.944011 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-50bd1ce1-9261-4037-9e02-3f1effaa1052 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:00.952151 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-50bd1ce1-9261-4037-9e02-3f1effaa1052 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906" status: 200 len: 1319 microversion: 2.1 time: 0.147601 Sep 09 13:06:00.952712 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 501/994] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:00 2022] GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:01.379825 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-4caa2e58-7929-47f9-a87c-bcf479082b05 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:01.380443 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-4caa2e58-7929-47f9-a87c-bcf479082b05 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:01.388002 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4caa2e58-7929-47f9-a87c-bcf479082b05 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:01.388488 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4caa2e58-7929-47f9-a87c-bcf479082b05 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:01.388926 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4caa2e58-7929-47f9-a87c-bcf479082b05 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:01.389618 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4caa2e58-7929-47f9-a87c-bcf479082b05 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:01.390076 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4caa2e58-7929-47f9-a87c-bcf479082b05 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:01.390532 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4caa2e58-7929-47f9-a87c-bcf479082b05 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:01.508996 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=2 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:06:01.523790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-4caa2e58-7929-47f9-a87c-bcf479082b05 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:01.531912 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-4caa2e58-7929-47f9-a87c-bcf479082b05 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1678 microversion: 2.1 time: 0.155918 Sep 09 13:06:01.532486 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 494/995] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:01 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:01.975063 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-1fac236f-b8b6-43af-808b-9396b601967b tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:01.975689 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-1fac236f-b8b6-43af-808b-9396b601967b tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 06aed0fe-2740-4d1a-a8ff-7e12703b7906] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:01.977662 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=2 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:06:01.978336 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=6 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:06:01.984334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1fac236f-b8b6-43af-808b-9396b601967b tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:01.984829 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1fac236f-b8b6-43af-808b-9396b601967b tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:01.985271 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1fac236f-b8b6-43af-808b-9396b601967b tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:01.985974 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1fac236f-b8b6-43af-808b-9396b601967b tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:01.986434 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1fac236f-b8b6-43af-808b-9396b601967b tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:01.986893 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1fac236f-b8b6-43af-808b-9396b601967b tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:02.129900 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-1fac236f-b8b6-43af-808b-9396b601967b tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:02.138326 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-1fac236f-b8b6-43af-808b-9396b601967b tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906" status: 200 len: 1319 microversion: 2.1 time: 0.167034 Sep 09 13:06:02.139521 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 502/996] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:01 2022] GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:02.241048 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-d8f2226d-3287-41ba-80a8-3d0807bd26ec req-7bc6fb0e-d12b-4d33-806c-11b4bef9ae71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06aed0fe-2740-4d1a-a8ff-7e12703b7906", "name": "network-vif-plugged", "status": "completed", "tag": "ad32fe5c-fe69-4514-80dc-5be0d7fcf55a"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:06:02.252807 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-d8f2226d-3287-41ba-80a8-3d0807bd26ec req-7bc6fb0e-d12b-4d33-806c-11b4bef9ae71 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:02.255633 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-d8f2226d-3287-41ba-80a8-3d0807bd26ec req-7bc6fb0e-d12b-4d33-806c-11b4bef9ae71 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:02.255633 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-d8f2226d-3287-41ba-80a8-3d0807bd26ec req-7bc6fb0e-d12b-4d33-806c-11b4bef9ae71 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:02.264549 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-d8f2226d-3287-41ba-80a8-3d0807bd26ec req-7bc6fb0e-d12b-4d33-806c-11b4bef9ae71 service nova] Creating event network-vif-plugged:ad32fe5c-fe69-4514-80dc-5be0d7fcf55a for instance 06aed0fe-2740-4d1a-a8ff-7e12703b7906 on hv-cinder-81322 Sep 09 13:06:02.269551 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-d8f2226d-3287-41ba-80a8-3d0807bd26ec req-7bc6fb0e-d12b-4d33-806c-11b4bef9ae71 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032277 Sep 09 13:06:02.270132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 495/997] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:06:02.555506 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-6d4b3289-c129-4789-b4d0-fde3f6726cea tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:02.556239 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-6d4b3289-c129-4789-b4d0-fde3f6726cea tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:02.562632 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6d4b3289-c129-4789-b4d0-fde3f6726cea tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:02.563132 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6d4b3289-c129-4789-b4d0-fde3f6726cea tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:02.563580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6d4b3289-c129-4789-b4d0-fde3f6726cea tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:02.564287 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6d4b3289-c129-4789-b4d0-fde3f6726cea tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:02.564750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6d4b3289-c129-4789-b4d0-fde3f6726cea tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:02.565181 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6d4b3289-c129-4789-b4d0-fde3f6726cea tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:02.696647 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-6d4b3289-c129-4789-b4d0-fde3f6726cea tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:02.705423 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-6d4b3289-c129-4789-b4d0-fde3f6726cea tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1655 microversion: 2.1 time: 0.153829 Sep 09 13:06:02.705992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 503/998] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:02 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1655 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:06:02.730206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-d8b926b2-8860-48ee-aa41-310d85453173 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:06:02.736369 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d8b926b2-8860-48ee-aa41-310d85453173 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:02.736900 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d8b926b2-8860-48ee-aa41-310d85453173 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:02.737329 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d8b926b2-8860-48ee-aa41-310d85453173 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:02.758955 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-d8b926b2-8860-48ee-aa41-310d85453173 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Going to try to start instance {{(pid=127772) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 13:06:02.948420 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-d8b926b2-8860-48ee-aa41-310d85453173 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "POST /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0/action" status: 202 len: 0 microversion: 2.1 time: 0.221824 Sep 09 13:06:02.948849 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 496/999] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 13:06:02 2022] POST /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:06:02.957016 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-4f9ccd4c-6a93-4a75-8047-e6d133f04b08 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:02.957635 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-4f9ccd4c-6a93-4a75-8047-e6d133f04b08 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:02.964446 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4f9ccd4c-6a93-4a75-8047-e6d133f04b08 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:02.964928 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4f9ccd4c-6a93-4a75-8047-e6d133f04b08 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:02.965372 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4f9ccd4c-6a93-4a75-8047-e6d133f04b08 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:02.966079 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4f9ccd4c-6a93-4a75-8047-e6d133f04b08 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:02.966560 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4f9ccd4c-6a93-4a75-8047-e6d133f04b08 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:02.966987 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4f9ccd4c-6a93-4a75-8047-e6d133f04b08 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:03.098259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-4f9ccd4c-6a93-4a75-8047-e6d133f04b08 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:03.106686 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-4f9ccd4c-6a93-4a75-8047-e6d133f04b08 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1664 microversion: 2.1 time: 0.153477 Sep 09 13:06:03.107268 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 504/1000] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:02 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:03.161844 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-00e65b5c-f354-446b-87e6-0d92fd56d811 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:03.162582 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-00e65b5c-f354-446b-87e6-0d92fd56d811 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 06aed0fe-2740-4d1a-a8ff-7e12703b7906] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:03.169388 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-00e65b5c-f354-446b-87e6-0d92fd56d811 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:03.169876 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-00e65b5c-f354-446b-87e6-0d92fd56d811 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:03.170337 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-00e65b5c-f354-446b-87e6-0d92fd56d811 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:03.171091 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-00e65b5c-f354-446b-87e6-0d92fd56d811 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:03.171547 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-00e65b5c-f354-446b-87e6-0d92fd56d811 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:03.171979 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-00e65b5c-f354-446b-87e6-0d92fd56d811 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:03.632190 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-00e65b5c-f354-446b-87e6-0d92fd56d811 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:03.640509 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-00e65b5c-f354-446b-87e6-0d92fd56d811 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906" status: 200 len: 1319 microversion: 2.1 time: 0.482996 Sep 09 13:06:03.650514 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 497/1001] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:03 2022] GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906 => generated 1319 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:04.131263 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-c7299962-d29d-4ed1-96d3-b896afafaa03 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:04.131883 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-c7299962-d29d-4ed1-96d3-b896afafaa03 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:04.138797 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c7299962-d29d-4ed1-96d3-b896afafaa03 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:04.139305 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c7299962-d29d-4ed1-96d3-b896afafaa03 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:04.139789 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c7299962-d29d-4ed1-96d3-b896afafaa03 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:04.140443 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c7299962-d29d-4ed1-96d3-b896afafaa03 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:04.140903 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c7299962-d29d-4ed1-96d3-b896afafaa03 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:04.141332 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c7299962-d29d-4ed1-96d3-b896afafaa03 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:04.284926 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-c7299962-d29d-4ed1-96d3-b896afafaa03 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:04.293006 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-c7299962-d29d-4ed1-96d3-b896afafaa03 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1664 microversion: 2.1 time: 0.165772 Sep 09 13:06:04.293580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 505/1002] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:04 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1664 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:04.667281 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-88c936fa-18b4-4a0c-9d60-0e88fbb02f08 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:04.667892 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-88c936fa-18b4-4a0c-9d60-0e88fbb02f08 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 06aed0fe-2740-4d1a-a8ff-7e12703b7906] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:04.674374 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88c936fa-18b4-4a0c-9d60-0e88fbb02f08 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:04.674883 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88c936fa-18b4-4a0c-9d60-0e88fbb02f08 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:04.675316 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88c936fa-18b4-4a0c-9d60-0e88fbb02f08 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:04.676000 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88c936fa-18b4-4a0c-9d60-0e88fbb02f08 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:04.676451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88c936fa-18b4-4a0c-9d60-0e88fbb02f08 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:04.676871 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88c936fa-18b4-4a0c-9d60-0e88fbb02f08 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:04.807704 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-88c936fa-18b4-4a0c-9d60-0e88fbb02f08 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:04.815474 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-88c936fa-18b4-4a0c-9d60-0e88fbb02f08 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906" status: 200 len: 1508 microversion: 2.1 time: 0.152650 Sep 09 13:06:04.816052 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 498/1003] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:04 2022] GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:04.839089 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d93bb6fc-8de8-4137-8626-4bd31bfea7dd tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8df084a3-c622-447e-9969-a8a4a67aa2ca", "device": "/dev/sdb"}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:06:04.841639 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-d93bb6fc-8de8-4137-8626-4bd31bfea7dd tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 06aed0fe-2740-4d1a-a8ff-7e12703b7906] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:04.847519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d93bb6fc-8de8-4137-8626-4bd31bfea7dd tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:04.848002 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d93bb6fc-8de8-4137-8626-4bd31bfea7dd tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:04.848441 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d93bb6fc-8de8-4137-8626-4bd31bfea7dd tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:04.849125 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d93bb6fc-8de8-4137-8626-4bd31bfea7dd tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:04.849583 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d93bb6fc-8de8-4137-8626-4bd31bfea7dd tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:04.850011 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d93bb6fc-8de8-4137-8626-4bd31bfea7dd tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:05.319355 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-967a731d-a7ab-401c-bc67-540d80124c07 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:05.319979 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-967a731d-a7ab-401c-bc67-540d80124c07 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:05.326907 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-967a731d-a7ab-401c-bc67-540d80124c07 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:05.327407 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-967a731d-a7ab-401c-bc67-540d80124c07 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:05.327846 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-967a731d-a7ab-401c-bc67-540d80124c07 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:05.328718 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-967a731d-a7ab-401c-bc67-540d80124c07 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:05.329225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-967a731d-a7ab-401c-bc67-540d80124c07 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:05.329642 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-967a731d-a7ab-401c-bc67-540d80124c07 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:05.470750 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-967a731d-a7ab-401c-bc67-540d80124c07 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:05.479120 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-967a731d-a7ab-401c-bc67-540d80124c07 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1664 microversion: 2.1 time: 0.163479 Sep 09 13:06:05.479935 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 499/1004] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:05 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1664 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:06:05.924640 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d93bb6fc-8de8-4137-8626-4bd31bfea7dd tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "POST /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.089650 Sep 09 13:06:05.925472 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 506/1005] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 13:06:04 2022] POST /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906/os-volume_attachments => generated 194 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:06:06.503375 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-d6a3a7d1-47e3-44a8-8f5a-1ae2091a6cf4 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:06.503995 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-d6a3a7d1-47e3-44a8-8f5a-1ae2091a6cf4 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:06.510942 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d6a3a7d1-47e3-44a8-8f5a-1ae2091a6cf4 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:06.511514 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d6a3a7d1-47e3-44a8-8f5a-1ae2091a6cf4 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:06.511959 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d6a3a7d1-47e3-44a8-8f5a-1ae2091a6cf4 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:06.512665 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d6a3a7d1-47e3-44a8-8f5a-1ae2091a6cf4 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:06.513130 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d6a3a7d1-47e3-44a8-8f5a-1ae2091a6cf4 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:06.513563 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-d6a3a7d1-47e3-44a8-8f5a-1ae2091a6cf4 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:06.644454 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-d6a3a7d1-47e3-44a8-8f5a-1ae2091a6cf4 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:06.652356 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-d6a3a7d1-47e3-44a8-8f5a-1ae2091a6cf4 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1668 microversion: 2.1 time: 0.152992 Sep 09 13:06:06.652921 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 500/1006] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:06 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:25.855813 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-05a44d49-01d0-4d89-bd0c-044b2fee1128 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:25.856392 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-05a44d49-01d0-4d89-bd0c-044b2fee1128 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 06aed0fe-2740-4d1a-a8ff-7e12703b7906] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:25.859012 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:06:25.859836 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:06:25.864893 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-05a44d49-01d0-4d89-bd0c-044b2fee1128 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:25.865380 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-05a44d49-01d0-4d89-bd0c-044b2fee1128 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:25.865841 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-05a44d49-01d0-4d89-bd0c-044b2fee1128 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:25.866616 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-05a44d49-01d0-4d89-bd0c-044b2fee1128 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:25.882193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-05a44d49-01d0-4d89-bd0c-044b2fee1128 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:25.882193 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-05a44d49-01d0-4d89-bd0c-044b2fee1128 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:25.999541 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.objects.instance [None req-05a44d49-01d0-4d89-bd0c-044b2fee1128 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lazy-loading 'services' on Instance uuid 06aed0fe-2740-4d1a-a8ff-7e12703b7906 {{(pid=127771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:06:26.206447 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-05a44d49-01d0-4d89-bd0c-044b2fee1128 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "DELETE /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906/os-volume_attachments/8df084a3-c622-447e-9969-a8a4a67aa2ca" status: 202 len: 0 microversion: 2.1 time: 0.355139 Sep 09 13:06:26.207062 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 507/1007] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 13:06:25 2022] DELETE /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906/os-volume_attachments/8df084a3-c622-447e-9969-a8a4a67aa2ca => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:06:27.329260 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-4867fe00-f6a4-4644-890b-cfad5ec74918 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:27.329765 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-4867fe00-f6a4-4644-890b-cfad5ec74918 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 06aed0fe-2740-4d1a-a8ff-7e12703b7906] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:27.331996 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=45 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:06:27.333859 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:06:27.338057 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4867fe00-f6a4-4644-890b-cfad5ec74918 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:27.338523 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4867fe00-f6a4-4644-890b-cfad5ec74918 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:27.339083 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4867fe00-f6a4-4644-890b-cfad5ec74918 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:27.339829 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4867fe00-f6a4-4644-890b-cfad5ec74918 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:27.340296 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4867fe00-f6a4-4644-890b-cfad5ec74918 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:27.340705 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4867fe00-f6a4-4644-890b-cfad5ec74918 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:27.368851 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-4867fe00-f6a4-4644-890b-cfad5ec74918 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 06aed0fe-2740-4d1a-a8ff-7e12703b7906] Going to try to terminate instance {{(pid=127772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:06:27.607299 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-4867fe00-f6a4-4644-890b-cfad5ec74918 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "DELETE /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906" status: 204 len: 0 microversion: 2.1 time: 0.281611 Sep 09 13:06:27.607819 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 501/1008] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:06:27 2022] DELETE /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:06:27.617173 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-65d9a8d7-8b96-4d02-afa7-1f64dbcede37 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:27.617874 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-65d9a8d7-8b96-4d02-afa7-1f64dbcede37 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 06aed0fe-2740-4d1a-a8ff-7e12703b7906] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:27.624658 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-65d9a8d7-8b96-4d02-afa7-1f64dbcede37 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:27.625150 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-65d9a8d7-8b96-4d02-afa7-1f64dbcede37 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:27.625590 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-65d9a8d7-8b96-4d02-afa7-1f64dbcede37 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:27.626283 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-65d9a8d7-8b96-4d02-afa7-1f64dbcede37 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:27.626765 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-65d9a8d7-8b96-4d02-afa7-1f64dbcede37 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:27.627194 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-65d9a8d7-8b96-4d02-afa7-1f64dbcede37 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:27.760910 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-65d9a8d7-8b96-4d02-afa7-1f64dbcede37 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:27.768568 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-65d9a8d7-8b96-4d02-afa7-1f64dbcede37 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906" status: 200 len: 1514 microversion: 2.1 time: 0.156304 Sep 09 13:06:27.769129 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 508/1009] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:27 2022] GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:28.792820 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-42357b6d-3224-46a6-852c-8cb8d2bea2c7 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:28.793573 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-42357b6d-3224-46a6-852c-8cb8d2bea2c7 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 06aed0fe-2740-4d1a-a8ff-7e12703b7906] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:28.800524 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-42357b6d-3224-46a6-852c-8cb8d2bea2c7 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:28.801001 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-42357b6d-3224-46a6-852c-8cb8d2bea2c7 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:28.801427 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-42357b6d-3224-46a6-852c-8cb8d2bea2c7 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:28.802137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-42357b6d-3224-46a6-852c-8cb8d2bea2c7 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:28.802608 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-42357b6d-3224-46a6-852c-8cb8d2bea2c7 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:28.803029 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-42357b6d-3224-46a6-852c-8cb8d2bea2c7 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:28.984105 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-42357b6d-3224-46a6-852c-8cb8d2bea2c7 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:28.991825 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-42357b6d-3224-46a6-852c-8cb8d2bea2c7 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906" status: 200 len: 1514 microversion: 2.1 time: 0.203800 Sep 09 13:06:28.992390 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 502/1010] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:28 2022] GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906 => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:29.969860 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-5dcea11c-c652-4665-8422-91c1c61ee1bf req-55afc036-7042-4ce2-af55-4e34ca9edd50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06aed0fe-2740-4d1a-a8ff-7e12703b7906", "name": "network-vif-deleted", "tag": "ad32fe5c-fe69-4514-80dc-5be0d7fcf55a"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:06:29.980145 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-5dcea11c-c652-4665-8422-91c1c61ee1bf req-55afc036-7042-4ce2-af55-4e34ca9edd50 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:29.980624 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-5dcea11c-c652-4665-8422-91c1c61ee1bf req-55afc036-7042-4ce2-af55-4e34ca9edd50 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:29.981056 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-5dcea11c-c652-4665-8422-91c1c61ee1bf req-55afc036-7042-4ce2-af55-4e34ca9edd50 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:29.991852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-5dcea11c-c652-4665-8422-91c1c61ee1bf req-55afc036-7042-4ce2-af55-4e34ca9edd50 service nova] Creating event network-vif-deleted:ad32fe5c-fe69-4514-80dc-5be0d7fcf55a for instance 06aed0fe-2740-4d1a-a8ff-7e12703b7906 on hv-cinder-81322 Sep 09 13:06:29.997412 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-5dcea11c-c652-4665-8422-91c1c61ee1bf req-55afc036-7042-4ce2-af55-4e34ca9edd50 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031223 Sep 09 13:06:29.998000 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 509/1011] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:06:30.015816 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ebb76f20-c895-46bd-ae06-2f9c774ec6ed tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:30.022294 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-ebb76f20-c895-46bd-ae06-2f9c774ec6ed tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 06aed0fe-2740-4d1a-a8ff-7e12703b7906] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:30.023093 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ebb76f20-c895-46bd-ae06-2f9c774ec6ed tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:30.023579 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ebb76f20-c895-46bd-ae06-2f9c774ec6ed tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:30.024015 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ebb76f20-c895-46bd-ae06-2f9c774ec6ed tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:30.024719 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ebb76f20-c895-46bd-ae06-2f9c774ec6ed tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:30.025196 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ebb76f20-c895-46bd-ae06-2f9c774ec6ed tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:30.025789 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ebb76f20-c895-46bd-ae06-2f9c774ec6ed tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:30.094966 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ebb76f20-c895-46bd-ae06-2f9c774ec6ed tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac7bf809174b6680a4eb5e088de614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372ca5d37ce94b8fa267f2ee7a81789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:30.102734 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-ebb76f20-c895-46bd-ae06-2f9c774ec6ed tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906" status: 200 len: 1472 microversion: 2.1 time: 0.090847 Sep 09 13:06:30.103375 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 503/1012] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:30 2022] GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906 => generated 1472 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:31.126715 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0d3e2505-65c7-4979-a211-cbd695ec76d8 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:31.127467 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-0d3e2505-65c7-4979-a211-cbd695ec76d8 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] [instance: 06aed0fe-2740-4d1a-a8ff-7e12703b7906] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:31.133628 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0d3e2505-65c7-4979-a211-cbd695ec76d8 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:31.139289 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0d3e2505-65c7-4979-a211-cbd695ec76d8 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:31.139289 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0d3e2505-65c7-4979-a211-cbd695ec76d8 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:31.139289 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0d3e2505-65c7-4979-a211-cbd695ec76d8 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:31.139289 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0d3e2505-65c7-4979-a211-cbd695ec76d8 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:31.139664 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0d3e2505-65c7-4979-a211-cbd695ec76d8 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:31.149924 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-0d3e2505-65c7-4979-a211-cbd695ec76d8 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] HTTP exception thrown: Instance 06aed0fe-2740-4d1a-a8ff-7e12703b7906 could not be found. Sep 09 13:06:31.152251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0d3e2505-65c7-4979-a211-cbd695ec76d8 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Request method failure captured: Sep 09 13:06:31.152251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906 HTTP/1.1 Sep 09 13:06:31.152251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:06:31.152251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:06:31.152251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:06:31.152251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:06:31.152251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:06:31.152251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:06:31.152251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:06:31.152251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:06:31.152251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGznkabAyzgAtXyb6yS1h1sbaN_fo8b6etClwgCyCNM4E8e21ruFoFviVSTD_9NFFeVjbcpIPAIqZEGNwuy1fAeWKR_4EV1kFDCDKbLyuTkqfui4CiARwjRURaZkU13wugos6cgUG3gm0VV4fXi5uNy0o-CqSj-5AG3-eeyJLfFNHolg Sep 09 13:06:31.152251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:06:31.152251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:06:31.152251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:06:31.152251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:06:31.152251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:06:31.152251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:06:31.152251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: 372ca5d37ce94b8fa267f2ee7a81789e Sep 09 13:06:31.152251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-VolumesSnapshotTestJSON-835679475 Sep 09 13:06:31.152251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:06:31.152251 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:06:31.153933 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/372ca5d37ce94b8fa267f2ee7a81789e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_372ca5d37ce94b8fa267f2ee7a81789e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/372ca5d37ce94b8fa267f2ee7a81789e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/372ca5d37ce94b8fa267f2ee7a81789e"}]}] Sep 09 13:06:31.153933 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-VolumesSnapshotTestJSON-835679475 Sep 09 13:06:31.153933 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: 372ca5d37ce94b8fa267f2ee7a81789e Sep 09 13:06:31.153933 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-835679475 Sep 09 13:06:31.153933 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-VolumesSnapshotTestJSON-835679475-project Sep 09 13:06:31.153933 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:06:31.153933 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:06:31.153933 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: c9ac7bf809174b6680a4eb5e088de614 Sep 09 13:06:31.153933 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-VolumesSnapshotTestJSON-835679475-project Sep 09 13:06:31.153933 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:06:31.153933 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance 06aed0fe-2740-4d1a-a8ff-7e12703b7906 could not be found. Sep 09 13:06:31.153933 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': '06aed0fe-2740-4d1a-a8ff-7e12703b7906'} Sep 09 13:06:31.154885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:06:31.154885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:06:31.154885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:06:31.154885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:06:31.154885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:06:31.154885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:06:31.154885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:06:31.154885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:06:31.154885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:06:31.154885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:06:31.154885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06aed0fe-2740-4d1a-a8ff-7e12703b7906 could not be found. Sep 09 13:06:31.154885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:06:31.154885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:06:31.154885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:06:31.154885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:06:31.154885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:06:31.154885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:06:31.154885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:06:31.154885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:06:31.154885 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:06:31.156437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:06:31.156437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:06:31.156437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:06:31.156437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:06:31.156437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:06:31.156437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:06:31.156437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:06:31.156437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06aed0fe-2740-4d1a-a8ff-7e12703b7906 could not be found. Sep 09 13:06:31.156437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:06:31.156437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:06:31.156437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:06:31.156437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:06:31.156437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:06:31.156437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:06:31.156437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:06:31.156437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:06:31.156437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06aed0fe-2740-4d1a-a8ff-7e12703b7906 could not be found. Sep 09 13:06:31.156437 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:06:31.158357 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0d3e2505-65c7-4979-a211-cbd695ec76d8 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] Returning 404 to user: Instance 06aed0fe-2740-4d1a-a8ff-7e12703b7906 could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:06:31.158357 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0d3e2505-65c7-4979-a211-cbd695ec76d8 tempest-VolumesSnapshotTestJSON-835679475 tempest-VolumesSnapshotTestJSON-835679475-project] 10.222.0.46 "GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906" status: 404 len: 111 microversion: 2.1 time: 0.031836 Sep 09 13:06:31.158357 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 510/1013] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:31 2022] GET /compute/v2.1/servers/06aed0fe-2740-4d1a-a8ff-7e12703b7906 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:06:48.678432 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-0734e9cc-86bc-456b-aa0a-e87bbd4785f3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:48.679702 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-567404cd-6d83-4449-b530-e4ea22223e48 req-393ebaa5-4430-4aaa-b5ea-74e40e1e150a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0325a8c5-db4f-4392-aa58-fc53eb462135", "tag": "3222ab4b-e295-4bda-9942-ac4365118d85"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:06:48.680273 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-0734e9cc-86bc-456b-aa0a-e87bbd4785f3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:48.689418 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:06:48.690103 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:06:48.695175 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0734e9cc-86bc-456b-aa0a-e87bbd4785f3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:48.695702 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0734e9cc-86bc-456b-aa0a-e87bbd4785f3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:48.696148 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0734e9cc-86bc-456b-aa0a-e87bbd4785f3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:48.696847 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0734e9cc-86bc-456b-aa0a-e87bbd4785f3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:48.697304 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0734e9cc-86bc-456b-aa0a-e87bbd4785f3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:48.697722 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-0734e9cc-86bc-456b-aa0a-e87bbd4785f3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:48.698356 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=8 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:06:48.699172 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:06:48.703204 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-567404cd-6d83-4449-b530-e4ea22223e48 req-393ebaa5-4430-4aaa-b5ea-74e40e1e150a service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:48.703687 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-567404cd-6d83-4449-b530-e4ea22223e48 req-393ebaa5-4430-4aaa-b5ea-74e40e1e150a service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:48.704125 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-567404cd-6d83-4449-b530-e4ea22223e48 req-393ebaa5-4430-4aaa-b5ea-74e40e1e150a service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:48.721358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-567404cd-6d83-4449-b530-e4ea22223e48 req-393ebaa5-4430-4aaa-b5ea-74e40e1e150a service nova] Creating event network-changed:3222ab4b-e295-4bda-9942-ac4365118d85 for instance 0325a8c5-db4f-4392-aa58-fc53eb462135 on hv-cinder-81322 Sep 09 13:06:48.729376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-0734e9cc-86bc-456b-aa0a-e87bbd4785f3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Going to try to terminate instance {{(pid=127772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:06:48.733102 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-567404cd-6d83-4449-b530-e4ea22223e48 req-393ebaa5-4430-4aaa-b5ea-74e40e1e150a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057396 Sep 09 13:06:48.733711 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 511/1014] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:06:48.765928 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8278937e-4846-4d54-b796-6fca9db460c5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:48.768581 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-8278937e-4846-4d54-b796-6fca9db460c5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:48.775239 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8278937e-4846-4d54-b796-6fca9db460c5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:48.780033 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8278937e-4846-4d54-b796-6fca9db460c5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:48.780033 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8278937e-4846-4d54-b796-6fca9db460c5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:48.780033 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8278937e-4846-4d54-b796-6fca9db460c5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:48.780033 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8278937e-4846-4d54-b796-6fca9db460c5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:48.780466 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8278937e-4846-4d54-b796-6fca9db460c5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:48.811091 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-8278937e-4846-4d54-b796-6fca9db460c5 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049478 Sep 09 13:06:48.811792 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 512/1015] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:06:48 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 13:06:48.881515 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-f97d55dc-69b0-4c4f-83bc-bc2dbe49fd28 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:48.882021 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-f97d55dc-69b0-4c4f-83bc-bc2dbe49fd28 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:48.888949 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f97d55dc-69b0-4c4f-83bc-bc2dbe49fd28 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:48.892080 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f97d55dc-69b0-4c4f-83bc-bc2dbe49fd28 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:48.892080 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f97d55dc-69b0-4c4f-83bc-bc2dbe49fd28 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:48.892080 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f97d55dc-69b0-4c4f-83bc-bc2dbe49fd28 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:48.892080 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f97d55dc-69b0-4c4f-83bc-bc2dbe49fd28 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:48.892469 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-f97d55dc-69b0-4c4f-83bc-bc2dbe49fd28 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:48.919121 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-f97d55dc-69b0-4c4f-83bc-bc2dbe49fd28 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Going to try to terminate instance {{(pid=127771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:06:49.085866 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-0734e9cc-86bc-456b-aa0a-e87bbd4785f3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 204 len: 0 microversion: 2.1 time: 0.414894 Sep 09 13:06:49.086960 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 504/1016] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:06:48 2022] DELETE /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:06:49.095556 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7af63d1a-c0d7-40c3-a643-6f36797a8e67 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:49.096494 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7af63d1a-c0d7-40c3-a643-6f36797a8e67 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:49.107018 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7af63d1a-c0d7-40c3-a643-6f36797a8e67 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:49.107792 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7af63d1a-c0d7-40c3-a643-6f36797a8e67 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:49.108222 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7af63d1a-c0d7-40c3-a643-6f36797a8e67 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:49.109103 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7af63d1a-c0d7-40c3-a643-6f36797a8e67 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:49.109592 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7af63d1a-c0d7-40c3-a643-6f36797a8e67 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:49.110017 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7af63d1a-c0d7-40c3-a643-6f36797a8e67 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:49.201889 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-f97d55dc-69b0-4c4f-83bc-bc2dbe49fd28 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 204 len: 0 microversion: 2.1 time: 0.323968 Sep 09 13:06:49.202631 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 513/1017] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:06:48 2022] DELETE /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:06:49.212185 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-6e1d068d-13e8-4746-b586-d03cabe08599 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:49.212997 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-6e1d068d-13e8-4746-b586-d03cabe08599 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:49.219706 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6e1d068d-13e8-4746-b586-d03cabe08599 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:49.220279 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6e1d068d-13e8-4746-b586-d03cabe08599 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:49.220851 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6e1d068d-13e8-4746-b586-d03cabe08599 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:49.221627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6e1d068d-13e8-4746-b586-d03cabe08599 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:49.222530 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6e1d068d-13e8-4746-b586-d03cabe08599 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:49.223055 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6e1d068d-13e8-4746-b586-d03cabe08599 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:49.278315 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7af63d1a-c0d7-40c3-a643-6f36797a8e67 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:49.287801 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7af63d1a-c0d7-40c3-a643-6f36797a8e67 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1578 microversion: 2.1 time: 0.196202 Sep 09 13:06:49.288540 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 505/1018] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:49 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1578 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:49.383898 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-6e1d068d-13e8-4746-b586-d03cabe08599 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:49.392690 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-6e1d068d-13e8-4746-b586-d03cabe08599 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1674 microversion: 2.1 time: 0.185448 Sep 09 13:06:49.393375 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 514/1019] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:49 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1674 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:50.313576 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-6706af2b-2435-4b9f-a053-687f06b33ca7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:50.314222 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-6706af2b-2435-4b9f-a053-687f06b33ca7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:50.320947 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6706af2b-2435-4b9f-a053-687f06b33ca7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:50.321438 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6706af2b-2435-4b9f-a053-687f06b33ca7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:50.321876 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6706af2b-2435-4b9f-a053-687f06b33ca7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:50.323117 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6706af2b-2435-4b9f-a053-687f06b33ca7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:50.324140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6706af2b-2435-4b9f-a053-687f06b33ca7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:50.324574 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6706af2b-2435-4b9f-a053-687f06b33ca7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:50.416858 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-14774a7b-7bb0-469b-9875-a685296e5725 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:50.417553 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-14774a7b-7bb0-469b-9875-a685296e5725 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:50.424452 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-14774a7b-7bb0-469b-9875-a685296e5725 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:50.427983 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-14774a7b-7bb0-469b-9875-a685296e5725 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:50.427983 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-14774a7b-7bb0-469b-9875-a685296e5725 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:50.427983 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-14774a7b-7bb0-469b-9875-a685296e5725 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:50.427983 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-14774a7b-7bb0-469b-9875-a685296e5725 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:50.428391 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-14774a7b-7bb0-469b-9875-a685296e5725 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:50.465889 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-6706af2b-2435-4b9f-a053-687f06b33ca7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:50.473840 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-6706af2b-2435-4b9f-a053-687f06b33ca7 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1578 microversion: 2.1 time: 0.164163 Sep 09 13:06:50.474689 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 506/1020] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:50 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:50.560751 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-14774a7b-7bb0-469b-9875-a685296e5725 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:50.568682 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-14774a7b-7bb0-469b-9875-a685296e5725 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1674 microversion: 2.1 time: 0.156202 Sep 09 13:06:50.569247 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 515/1021] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:50 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:06:51.497813 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-5ecd8739-d1e9-4145-a9e4-43aebb53658d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:51.498422 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-5ecd8739-d1e9-4145-a9e4-43aebb53658d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:51.504778 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5ecd8739-d1e9-4145-a9e4-43aebb53658d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:51.505265 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5ecd8739-d1e9-4145-a9e4-43aebb53658d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:51.505702 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5ecd8739-d1e9-4145-a9e4-43aebb53658d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:51.506393 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5ecd8739-d1e9-4145-a9e4-43aebb53658d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:51.506878 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5ecd8739-d1e9-4145-a9e4-43aebb53658d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:51.507308 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5ecd8739-d1e9-4145-a9e4-43aebb53658d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:51.609141 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-5b32384c-e870-4a25-9c70-ed0f1b1e6cd8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:51.609837 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-5b32384c-e870-4a25-9c70-ed0f1b1e6cd8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:51.616115 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5b32384c-e870-4a25-9c70-ed0f1b1e6cd8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:51.616601 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5b32384c-e870-4a25-9c70-ed0f1b1e6cd8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:51.617035 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5b32384c-e870-4a25-9c70-ed0f1b1e6cd8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:51.617732 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5b32384c-e870-4a25-9c70-ed0f1b1e6cd8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:51.618180 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5b32384c-e870-4a25-9c70-ed0f1b1e6cd8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:51.618629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5b32384c-e870-4a25-9c70-ed0f1b1e6cd8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:51.644635 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-5ecd8739-d1e9-4145-a9e4-43aebb53658d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:51.653216 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-5ecd8739-d1e9-4145-a9e4-43aebb53658d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1460 microversion: 2.1 time: 0.159704 Sep 09 13:06:51.653792 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 507/1022] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:51 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1460 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:51.750578 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-5b32384c-e870-4a25-9c70-ed0f1b1e6cd8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:51.758842 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-5b32384c-e870-4a25-9c70-ed0f1b1e6cd8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1674 microversion: 2.1 time: 0.163594 Sep 09 13:06:51.759410 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 516/1023] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:51 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:52.676380 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-790357ec-73fe-4b91-b94b-250b172a614d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:52.677005 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-790357ec-73fe-4b91-b94b-250b172a614d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:52.684203 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-790357ec-73fe-4b91-b94b-250b172a614d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:52.684696 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-790357ec-73fe-4b91-b94b-250b172a614d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:52.685139 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-790357ec-73fe-4b91-b94b-250b172a614d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:52.685876 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-790357ec-73fe-4b91-b94b-250b172a614d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:52.686336 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-790357ec-73fe-4b91-b94b-250b172a614d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:52.686791 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-790357ec-73fe-4b91-b94b-250b172a614d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:52.783574 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-c6ee8989-c2cb-4735-81e8-421de445c30a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:52.784189 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-c6ee8989-c2cb-4735-81e8-421de445c30a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:52.790594 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c6ee8989-c2cb-4735-81e8-421de445c30a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:52.791028 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c6ee8989-c2cb-4735-81e8-421de445c30a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:52.791494 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c6ee8989-c2cb-4735-81e8-421de445c30a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:52.792196 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c6ee8989-c2cb-4735-81e8-421de445c30a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:52.792656 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c6ee8989-c2cb-4735-81e8-421de445c30a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:52.793092 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-c6ee8989-c2cb-4735-81e8-421de445c30a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:52.929665 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-c6ee8989-c2cb-4735-81e8-421de445c30a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:52.938863 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-c6ee8989-c2cb-4735-81e8-421de445c30a tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1674 microversion: 2.1 time: 0.159153 Sep 09 13:06:52.939453 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 517/1024] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:52 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:06:53.269037 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-790357ec-73fe-4b91-b94b-250b172a614d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:53.277977 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-790357ec-73fe-4b91-b94b-250b172a614d tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1460 microversion: 2.1 time: 0.605466 Sep 09 13:06:53.278859 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 508/1025] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:52 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1460 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:53.753496 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-346acad8-7ddc-4506-9422-752a43e10ff5 req-abc789f2-e06b-460d-9cc5-ded94b196f19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0325a8c5-db4f-4392-aa58-fc53eb462135", "name": "network-vif-deleted", "tag": "3222ab4b-e295-4bda-9942-ac4365118d85"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:06:53.764497 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-346acad8-7ddc-4506-9422-752a43e10ff5 req-abc789f2-e06b-460d-9cc5-ded94b196f19 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:53.765192 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-346acad8-7ddc-4506-9422-752a43e10ff5 req-abc789f2-e06b-460d-9cc5-ded94b196f19 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:53.765690 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-346acad8-7ddc-4506-9422-752a43e10ff5 req-abc789f2-e06b-460d-9cc5-ded94b196f19 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:53.776990 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-346acad8-7ddc-4506-9422-752a43e10ff5 req-abc789f2-e06b-460d-9cc5-ded94b196f19 service nova] Creating event network-vif-deleted:3222ab4b-e295-4bda-9942-ac4365118d85 for instance 0325a8c5-db4f-4392-aa58-fc53eb462135 on hv-cinder-81322 Sep 09 13:06:53.782137 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-346acad8-7ddc-4506-9422-752a43e10ff5 req-abc789f2-e06b-460d-9cc5-ded94b196f19 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033842 Sep 09 13:06:53.783101 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 518/1026] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:06:53.964393 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-b6519d19-dabf-4705-933f-596d4661d9d0 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:53.965051 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-b6519d19-dabf-4705-933f-596d4661d9d0 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:53.971249 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b6519d19-dabf-4705-933f-596d4661d9d0 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:53.971743 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b6519d19-dabf-4705-933f-596d4661d9d0 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:53.972190 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b6519d19-dabf-4705-933f-596d4661d9d0 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:53.972895 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b6519d19-dabf-4705-933f-596d4661d9d0 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:53.973357 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b6519d19-dabf-4705-933f-596d4661d9d0 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:53.973800 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b6519d19-dabf-4705-933f-596d4661d9d0 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:54.063363 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-b6519d19-dabf-4705-933f-596d4661d9d0 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:54.078756 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-b6519d19-dabf-4705-933f-596d4661d9d0 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1607 microversion: 2.1 time: 0.118679 Sep 09 13:06:54.079354 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 509/1027] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:53 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1607 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:54.316015 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-16a36bfe-5465-49a2-bd7e-a83299d74bfe tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:54.316015 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-16a36bfe-5465-49a2-bd7e-a83299d74bfe tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:54.316015 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-16a36bfe-5465-49a2-bd7e-a83299d74bfe tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:54.316015 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-16a36bfe-5465-49a2-bd7e-a83299d74bfe tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:54.317065 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-16a36bfe-5465-49a2-bd7e-a83299d74bfe tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:54.317065 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-16a36bfe-5465-49a2-bd7e-a83299d74bfe tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:54.317065 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-16a36bfe-5465-49a2-bd7e-a83299d74bfe tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:54.317065 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-16a36bfe-5465-49a2-bd7e-a83299d74bfe tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:54.408215 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-16a36bfe-5465-49a2-bd7e-a83299d74bfe tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:54.417754 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-16a36bfe-5465-49a2-bd7e-a83299d74bfe tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 200 len: 1226 microversion: 2.1 time: 0.120148 Sep 09 13:06:54.431699 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 519/1028] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:54 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 1226 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:55.105120 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-f16e7261-b15a-408d-84be-b8a63a3f2594 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:55.106408 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-f16e7261-b15a-408d-84be-b8a63a3f2594 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:55.113471 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f16e7261-b15a-408d-84be-b8a63a3f2594 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:55.114121 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f16e7261-b15a-408d-84be-b8a63a3f2594 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:55.114707 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f16e7261-b15a-408d-84be-b8a63a3f2594 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:55.115803 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f16e7261-b15a-408d-84be-b8a63a3f2594 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:55.116238 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f16e7261-b15a-408d-84be-b8a63a3f2594 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:55.116929 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f16e7261-b15a-408d-84be-b8a63a3f2594 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:55.154123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f16e7261-b15a-408d-84be-b8a63a3f2594 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:55.154768 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f16e7261-b15a-408d-84be-b8a63a3f2594 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:55.155201 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f16e7261-b15a-408d-84be-b8a63a3f2594 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:55.155853 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.objects.instance [None req-f16e7261-b15a-408d-84be-b8a63a3f2594 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lazy-loading 'fault' on Instance uuid f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 {{(pid=127772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:06:55.209838 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-f16e7261-b15a-408d-84be-b8a63a3f2594 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:55.218640 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-f16e7261-b15a-408d-84be-b8a63a3f2594 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 200 len: 1328 microversion: 2.1 time: 0.120047 Sep 09 13:06:55.219218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 510/1029] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:55 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 1328 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:55.442453 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0026f0f1-fc23-4da0-99f1-f70b04b13369 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:55.443102 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-0026f0f1-fc23-4da0-99f1-f70b04b13369 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 0325a8c5-db4f-4392-aa58-fc53eb462135] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:55.450081 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0026f0f1-fc23-4da0-99f1-f70b04b13369 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:55.450639 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0026f0f1-fc23-4da0-99f1-f70b04b13369 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:55.451070 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0026f0f1-fc23-4da0-99f1-f70b04b13369 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:55.451769 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0026f0f1-fc23-4da0-99f1-f70b04b13369 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:55.452222 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0026f0f1-fc23-4da0-99f1-f70b04b13369 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:55.452649 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0026f0f1-fc23-4da0-99f1-f70b04b13369 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:55.470552 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-0026f0f1-fc23-4da0-99f1-f70b04b13369 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] HTTP exception thrown: Instance 0325a8c5-db4f-4392-aa58-fc53eb462135 could not be found. Sep 09 13:06:55.472740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0026f0f1-fc23-4da0-99f1-f70b04b13369 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Request method failure captured: Sep 09 13:06:55.472740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 HTTP/1.1 Sep 09 13:06:55.472740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:06:55.472740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:06:55.472740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:06:55.472740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:06:55.472740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:06:55.472740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:06:55.472740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:06:55.472740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:06:55.472740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGziBp0TaRLVpJdvMiJoN5D3Evvin9QSbVm_yv3jhPeMQtBMG8G_NILBFPo_KFyNseqTRGO2R_1FlOV7avlgPxGwpBN-SPbr84YKCS2rLKsGdRwGlmBOnz8geOjbljkzC_ct6cP6NFHtKzPG0fVBpGHwLALPrywi42LSTd9vtyqG6ZR4 Sep 09 13:06:55.472740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:06:55.472740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:06:55.472740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:06:55.472740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:06:55.472740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:06:55.472740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:06:55.472740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: d427be7da6084e009b87ff500858cdc8 Sep 09 13:06:55.472740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-TestVolumeBootPattern-956018443 Sep 09 13:06:55.472740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:06:55.472740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:06:55.474580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d427be7da6084e009b87ff500858cdc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d427be7da6084e009b87ff500858cdc8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d427be7da6084e009b87ff500858cdc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d427be7da6084e009b87ff500858cdc8"}]}] Sep 09 13:06:55.474580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-TestVolumeBootPattern-956018443 Sep 09 13:06:55.474580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: d427be7da6084e009b87ff500858cdc8 Sep 09 13:06:55.474580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-TestVolumeBootPattern-956018443 Sep 09 13:06:55.474580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-TestVolumeBootPattern-956018443-project Sep 09 13:06:55.474580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:06:55.474580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:06:55.474580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 4c96322c48c146c7b8bcb9959f533820 Sep 09 13:06:55.474580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-TestVolumeBootPattern-956018443-project Sep 09 13:06:55.474580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:06:55.474580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance 0325a8c5-db4f-4392-aa58-fc53eb462135 could not be found. Sep 09 13:06:55.474580 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': '0325a8c5-db4f-4392-aa58-fc53eb462135'} Sep 09 13:06:55.475564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:06:55.475564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:06:55.475564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:06:55.475564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:06:55.475564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:06:55.475564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:06:55.475564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:06:55.475564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:06:55.475564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:06:55.475564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:06:55.475564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0325a8c5-db4f-4392-aa58-fc53eb462135 could not be found. Sep 09 13:06:55.475564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:06:55.475564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:06:55.475564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:06:55.475564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:06:55.475564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:06:55.475564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:06:55.475564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:06:55.475564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:06:55.475564 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:06:55.477116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:06:55.477116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:06:55.477116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:06:55.477116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:06:55.477116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:06:55.477116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:06:55.477116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:06:55.477116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0325a8c5-db4f-4392-aa58-fc53eb462135 could not be found. Sep 09 13:06:55.477116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:06:55.477116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:06:55.477116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:06:55.477116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:06:55.477116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:06:55.477116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:06:55.477116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:06:55.477116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:06:55.477116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0325a8c5-db4f-4392-aa58-fc53eb462135 could not be found. Sep 09 13:06:55.477116 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:06:55.478998 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0026f0f1-fc23-4da0-99f1-f70b04b13369 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Returning 404 to user: Instance 0325a8c5-db4f-4392-aa58-fc53eb462135 could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:06:55.478998 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0026f0f1-fc23-4da0-99f1-f70b04b13369 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135" status: 404 len: 111 microversion: 2.1 time: 0.035318 Sep 09 13:06:55.478998 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 520/1030] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:55 2022] GET /compute/v2.1/servers/0325a8c5-db4f-4392-aa58-fc53eb462135 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:06:55.797519 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-eaa4119a-1a4e-4699-bfdb-9333a1a31643 req-cdb9d416-4277-419d-ab6b-5e0ca0750896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98258c7-e92a-4ad4-b8c1-9e3c698b48f0", "name": "network-vif-deleted", "tag": "29a5dfa1-972f-474a-a210-998d95332748"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:06:55.803040 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 13:06:55.803195 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Fri Sep 9 13:06:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.46) !!! Sep 09 13:06:55.816988 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-eaa4119a-1a4e-4699-bfdb-9333a1a31643 req-cdb9d416-4277-419d-ab6b-5e0ca0750896 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:55.817483 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-eaa4119a-1a4e-4699-bfdb-9333a1a31643 req-cdb9d416-4277-419d-ab6b-5e0ca0750896 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:55.817922 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-eaa4119a-1a4e-4699-bfdb-9333a1a31643 req-cdb9d416-4277-419d-ab6b-5e0ca0750896 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:55.831096 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-eaa4119a-1a4e-4699-bfdb-9333a1a31643 req-cdb9d416-4277-419d-ab6b-5e0ca0750896 service nova] Creating event network-vif-deleted:29a5dfa1-972f-474a-a210-998d95332748 for instance f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 on hv-cinder-81322 Sep 09 13:06:55.838097 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-eaa4119a-1a4e-4699-bfdb-9333a1a31643 req-cdb9d416-4277-419d-ab6b-5e0ca0750896 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042614 Sep 09 13:06:55.838810 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 511/1031] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:06:56.247921 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-6ac4f5ad-bd91-4704-8505-9ae6b45cd5aa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:56.248533 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-6ac4f5ad-bd91-4704-8505-9ae6b45cd5aa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:56.254933 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6ac4f5ad-bd91-4704-8505-9ae6b45cd5aa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:56.255416 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6ac4f5ad-bd91-4704-8505-9ae6b45cd5aa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:56.255855 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6ac4f5ad-bd91-4704-8505-9ae6b45cd5aa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:56.256569 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6ac4f5ad-bd91-4704-8505-9ae6b45cd5aa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:56.257029 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6ac4f5ad-bd91-4704-8505-9ae6b45cd5aa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:56.257456 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-6ac4f5ad-bd91-4704-8505-9ae6b45cd5aa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:56.271167 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-6ac4f5ad-bd91-4704-8505-9ae6b45cd5aa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] HTTP exception thrown: Instance f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 could not be found. Sep 09 13:06:56.272676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-6ac4f5ad-bd91-4704-8505-9ae6b45cd5aa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Request method failure captured: Sep 09 13:06:56.272676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 HTTP/1.1 Sep 09 13:06:56.272676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:06:56.272676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:06:56.272676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:06:56.272676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:06:56.272676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:06:56.272676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:06:56.272676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:06:56.272676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:06:56.272676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzmfgJ3KrOqJOQMzxl-_GnHMWXamRKgJBaf43ejB_EnLaUJL0769nWMJM_wTMM19ejRgnMYhDvvT6TNb9Jc6VkwSHhNLVVqB_uNoRRh-cIcsnuEhPzGPE3_ilUQMkY1cAKfQ8svoK88Sv7CaZSeaoMWudR76dVdDCEfBLrLb-DqmrvI Sep 09 13:06:56.272676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:06:56.272676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:06:56.272676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:06:56.272676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:06:56.272676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:06:56.272676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:06:56.272676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: 31f8b13a6a4844fc9fd20ab2c3ff7368 Sep 09 13:06:56.272676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-AttachVolumeTestJSON-183480646 Sep 09 13:06:56.272676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:06:56.272676 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:06:56.274385 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31f8b13a6a4844fc9fd20ab2c3ff7368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31f8b13a6a4844fc9fd20ab2c3ff7368", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31f8b13a6a4844fc9fd20ab2c3ff7368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31f8b13a6a4844fc9fd20ab2c3ff7368"}]}] Sep 09 13:06:56.274385 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-AttachVolumeTestJSON-183480646 Sep 09 13:06:56.274385 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: 31f8b13a6a4844fc9fd20ab2c3ff7368 Sep 09 13:06:56.274385 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-AttachVolumeTestJSON-183480646 Sep 09 13:06:56.274385 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-AttachVolumeTestJSON-183480646-project Sep 09 13:06:56.274385 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:06:56.274385 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:06:56.274385 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: bc2cc611fd9341fc9a6d8a5d49f43e53 Sep 09 13:06:56.274385 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-AttachVolumeTestJSON-183480646-project Sep 09 13:06:56.274385 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:06:56.274385 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 could not be found. Sep 09 13:06:56.274385 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': 'f98258c7-e92a-4ad4-b8c1-9e3c698b48f0'} Sep 09 13:06:56.276031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:06:56.276031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:06:56.276031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:06:56.276031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:06:56.276031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:06:56.276031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:06:56.276031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:06:56.276031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:06:56.276031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:06:56.276031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:06:56.276031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 could not be found. Sep 09 13:06:56.276031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:06:56.276031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:06:56.276031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:06:56.276031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:06:56.276031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:06:56.276031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:06:56.276031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:06:56.276031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:06:56.276031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:06:56.277517 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:06:56.277517 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:06:56.277517 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:06:56.277517 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:06:56.277517 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:06:56.277517 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:06:56.277517 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:06:56.277517 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 could not be found. Sep 09 13:06:56.277517 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:06:56.277517 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:06:56.277517 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:06:56.277517 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:06:56.277517 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:06:56.277517 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:06:56.277517 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:06:56.277517 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:06:56.277517 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 could not be found. Sep 09 13:06:56.277517 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:06:56.279013 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-6ac4f5ad-bd91-4704-8505-9ae6b45cd5aa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Returning 404 to user: Instance f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:06:56.279013 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-6ac4f5ad-bd91-4704-8505-9ae6b45cd5aa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 404 len: 111 microversion: 2.1 time: 0.030679 Sep 09 13:06:56.279013 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 521/1032] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:56 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:06:56.284123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-b480d8b5-00de-4a62-9dd4-6a7ab2a2aa67 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '.version_select at 0x7f3183012280>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:56.382911 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-b480d8b5-00de-4a62-9dd4-6a7ab2a2aa67 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2037369865" status: 202 len: 0 microversion: 2.1 time: 0.103475 Sep 09 13:06:56.383446 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 512/1033] 10.222.0.46 () {58 vars in 1221 bytes} [Fri Sep 9 13:06:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2037369865 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:06:57.215434 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0f637437-545b-4883-9eb2-d5501389729b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Action: 'create', calling method: .version_select at 0x7f31830d5310>, body: {"keypair": {"name": "tempest-keypair-1192913916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/HhtE5aPQZbLj9X/gT4KVb3fhLiglKlT+2b5LhhVP6RAMP2jXfS3TaFXPwizMMleFqTkPIVKQSy0OEutgcuBBJga0k8thDiwcIs9WZXOdRJuNb0DIE7IZ5hLElU9k8Fw=="}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:06:57.232315 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-0f637437-545b-4883-9eb2-d5501389729b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Getting quotas for project 31f8b13a6a4844fc9fd20ab2c3ff7368. Resources: {'key_pairs'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:06:57.236371 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.quota [None req-0f637437-545b-4883-9eb2-d5501389729b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Getting quotas for user bc2cc611fd9341fc9a6d8a5d49f43e53 and project 31f8b13a6a4844fc9fd20ab2c3ff7368. Resources: {'key_pairs'} {{(pid=127771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:06:57.323105 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0f637437-545b-4883-9eb2-d5501389729b tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.112877 Sep 09 13:06:57.323876 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 522/1034] 10.222.0.46 () {60 vars in 1159 bytes} [Fri Sep 9 13:06:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:06:59.190689 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-cee4e05a-abd4-479e-a238-f4cde52a54e4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:59.191888 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-cee4e05a-abd4-479e-a238-f4cde52a54e4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:59.192027 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-fa743a5d-ee7e-40b6-bdc3-bf01554faf51 req-2c8bfe8c-493b-4ced-b3b5-2e4002be19f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a161d78-b95c-41f2-a747-3bc9376c5058", "tag": "be2358f4-e985-4509-9168-4b4923220982"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:06:59.200532 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-cee4e05a-abd4-479e-a238-f4cde52a54e4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:59.201308 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-cee4e05a-abd4-479e-a238-f4cde52a54e4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:59.201961 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-cee4e05a-abd4-479e-a238-f4cde52a54e4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:59.202981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-cee4e05a-abd4-479e-a238-f4cde52a54e4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:59.203103 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-fa743a5d-ee7e-40b6-bdc3-bf01554faf51 req-2c8bfe8c-493b-4ced-b3b5-2e4002be19f6 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:59.203569 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-fa743a5d-ee7e-40b6-bdc3-bf01554faf51 req-2c8bfe8c-493b-4ced-b3b5-2e4002be19f6 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:59.204013 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-fa743a5d-ee7e-40b6-bdc3-bf01554faf51 req-2c8bfe8c-493b-4ced-b3b5-2e4002be19f6 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:59.204678 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-cee4e05a-abd4-479e-a238-f4cde52a54e4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:59.205222 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-cee4e05a-abd4-479e-a238-f4cde52a54e4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:59.216381 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-fa743a5d-ee7e-40b6-bdc3-bf01554faf51 req-2c8bfe8c-493b-4ced-b3b5-2e4002be19f6 service nova] Creating event network-changed:be2358f4-e985-4509-9168-4b4923220982 for instance 2a161d78-b95c-41f2-a747-3bc9376c5058 on hv-cinder-81322 Sep 09 13:06:59.221617 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-fa743a5d-ee7e-40b6-bdc3-bf01554faf51 req-2c8bfe8c-493b-4ced-b3b5-2e4002be19f6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033454 Sep 09 13:06:59.222214 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 523/1035] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:06:59.236608 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-cee4e05a-abd4-479e-a238-f4cde52a54e4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Going to try to terminate instance {{(pid=127772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:06:59.595379 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-cee4e05a-abd4-479e-a238-f4cde52a54e4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 204 len: 0 microversion: 2.1 time: 0.409350 Sep 09 13:06:59.599633 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 513/1036] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:06:59 2022] DELETE /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:06:59.606364 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-aca71b94-984f-4b19-abf6-29c2565e00d4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:59.607140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-aca71b94-984f-4b19-abf6-29c2565e00d4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:06:59.614281 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aca71b94-984f-4b19-abf6-29c2565e00d4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:59.614815 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aca71b94-984f-4b19-abf6-29c2565e00d4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:59.621938 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aca71b94-984f-4b19-abf6-29c2565e00d4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:59.623154 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aca71b94-984f-4b19-abf6-29c2565e00d4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:59.623821 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aca71b94-984f-4b19-abf6-29c2565e00d4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:59.624438 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-aca71b94-984f-4b19-abf6-29c2565e00d4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:59.785944 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-aca71b94-984f-4b19-abf6-29c2565e00d4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:06:59.794010 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-aca71b94-984f-4b19-abf6-29c2565e00d4 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1579 microversion: 2.1 time: 0.192988 Sep 09 13:06:59.794787 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 524/1037] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:06:59 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1579 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:06:59.852317 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7825dd37-ea23-45e1-a7d5-195185155b0f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-521196516", "imageRef": "355bded2-2225-44b2-af86-f9e1861d05ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b64c32cb-4424-44fe-9a55-9c55babbfafd"}], "security_groups": [{"name": "tempest-securitygroup--2099862414"}], "key_name": "tempest-keypair-1192913916", "user_data": "}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:06:59.962881 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.network.neutron [None req-7825dd37-ea23-45e1-a7d5-195185155b0f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] validate_networks() for [('b64c32cb-4424-44fe-9a55-9c55babbfafd', None, None, None, None, None)] {{(pid=127772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:07:00.354645 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-7825dd37-ea23-45e1-a7d5-195185155b0f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Flavor limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:07:00.355229 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-7825dd37-ea23-45e1-a7d5-195185155b0f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Image limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:07:00.355623 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-7825dd37-ea23-45e1-a7d5-195185155b0f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Flavor pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:07:00.356046 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-7825dd37-ea23-45e1-a7d5-195185155b0f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Image pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:07:00.356489 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-7825dd37-ea23-45e1-a7d5-195185155b0f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:07:00.365341 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7825dd37-ea23-45e1-a7d5-195185155b0f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:00.365819 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7825dd37-ea23-45e1-a7d5-195185155b0f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:00.366281 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7825dd37-ea23-45e1-a7d5-195185155b0f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:00.367043 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7825dd37-ea23-45e1-a7d5-195185155b0f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:00.367498 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7825dd37-ea23-45e1-a7d5-195185155b0f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:00.367922 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7825dd37-ea23-45e1-a7d5-195185155b0f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:00.385155 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-7825dd37-ea23-45e1-a7d5-195185155b0f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Getting quotas for project 31f8b13a6a4844fc9fd20ab2c3ff7368. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:07:00.389964 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-7825dd37-ea23-45e1-a7d5-195185155b0f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Getting quotas for user bc2cc611fd9341fc9a6d8a5d49f43e53 and project 31f8b13a6a4844fc9fd20ab2c3ff7368. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:07:00.400902 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7825dd37-ea23-45e1-a7d5-195185155b0f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Going to run 1 instances... {{(pid=127772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:07:00.403330 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7825dd37-ea23-45e1-a7d5-195185155b0f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='355bded2-2225-44b2-af86-f9e1861d05ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:07:00.529053 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7825dd37-ea23-45e1-a7d5-195185155b0f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.681472 Sep 09 13:07:00.529694 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 514/1038] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 13:06:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:07:00.540850 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-c2eccb80-21bd-42cb-aa3b-6e2add3aeb54 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:00.541973 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-c2eccb80-21bd-42cb-aa3b-6e2add3aeb54 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:00.609468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-c2eccb80-21bd-42cb-aa3b-6e2add3aeb54 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:07:00.616596 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-c2eccb80-21bd-42cb-aa3b-6e2add3aeb54 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4" status: 200 len: 1237 microversion: 2.1 time: 0.079530 Sep 09 13:07:00.617470 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 525/1039] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:07:00 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 => generated 1237 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:00.817136 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-50645243-5494-4943-93d9-b3055a68e799 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:00.817741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-50645243-5494-4943-93d9-b3055a68e799 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:00.823847 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-50645243-5494-4943-93d9-b3055a68e799 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:00.824334 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-50645243-5494-4943-93d9-b3055a68e799 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:00.824767 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-50645243-5494-4943-93d9-b3055a68e799 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:00.825486 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-50645243-5494-4943-93d9-b3055a68e799 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:00.825965 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-50645243-5494-4943-93d9-b3055a68e799 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:00.826356 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-50645243-5494-4943-93d9-b3055a68e799 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:01.012328 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-50645243-5494-4943-93d9-b3055a68e799 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:07:01.020559 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-50645243-5494-4943-93d9-b3055a68e799 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1579 microversion: 2.1 time: 0.207238 Sep 09 13:07:01.034577 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 515/1040] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:07:00 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1579 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:01.644538 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-1934e326-fd1c-49ab-a2aa-d7ec2d558c28 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:01.644538 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-1934e326-fd1c-49ab-a2aa-d7ec2d558c28 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:01.648847 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1934e326-fd1c-49ab-a2aa-d7ec2d558c28 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:01.649403 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1934e326-fd1c-49ab-a2aa-d7ec2d558c28 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:01.649855 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1934e326-fd1c-49ab-a2aa-d7ec2d558c28 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:01.650619 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1934e326-fd1c-49ab-a2aa-d7ec2d558c28 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:01.651755 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1934e326-fd1c-49ab-a2aa-d7ec2d558c28 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:01.652494 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1934e326-fd1c-49ab-a2aa-d7ec2d558c28 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:01.720606 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-1934e326-fd1c-49ab-a2aa-d7ec2d558c28 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:07:01.730698 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-1934e326-fd1c-49ab-a2aa-d7ec2d558c28 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4" status: 200 len: 1241 microversion: 2.1 time: 0.094007 Sep 09 13:07:01.731314 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 516/1041] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:07:01 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:07:01.772642 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-5013d08b-96a0-4f69-812b-ad01f0966211 req-48a54d22-45ba-4336-8614-65321aef387d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a161d78-b95c-41f2-a747-3bc9376c5058", "name": "network-vif-deleted", "tag": "be2358f4-e985-4509-9168-4b4923220982"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:07:01.784097 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-5013d08b-96a0-4f69-812b-ad01f0966211 req-48a54d22-45ba-4336-8614-65321aef387d service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:01.784583 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-5013d08b-96a0-4f69-812b-ad01f0966211 req-48a54d22-45ba-4336-8614-65321aef387d service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:01.785045 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-5013d08b-96a0-4f69-812b-ad01f0966211 req-48a54d22-45ba-4336-8614-65321aef387d service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:01.796742 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-5013d08b-96a0-4f69-812b-ad01f0966211 req-48a54d22-45ba-4336-8614-65321aef387d service nova] Creating event network-vif-deleted:be2358f4-e985-4509-9168-4b4923220982 for instance 2a161d78-b95c-41f2-a747-3bc9376c5058 on hv-cinder-81322 Sep 09 13:07:01.801199 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-5013d08b-96a0-4f69-812b-ad01f0966211 req-48a54d22-45ba-4336-8614-65321aef387d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166634 Sep 09 13:07:01.801811 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 526/1042] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:07:02.045403 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-6b5bd545-c55a-4a6a-9cd8-0791f482fd59 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:02.046019 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-6b5bd545-c55a-4a6a-9cd8-0791f482fd59 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:02.052280 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6b5bd545-c55a-4a6a-9cd8-0791f482fd59 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:02.052777 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6b5bd545-c55a-4a6a-9cd8-0791f482fd59 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:02.053248 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6b5bd545-c55a-4a6a-9cd8-0791f482fd59 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:02.053987 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6b5bd545-c55a-4a6a-9cd8-0791f482fd59 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:02.054451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6b5bd545-c55a-4a6a-9cd8-0791f482fd59 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:02.054899 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-6b5bd545-c55a-4a6a-9cd8-0791f482fd59 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:02.128288 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-6b5bd545-c55a-4a6a-9cd8-0791f482fd59 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:07:02.132135 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-6b5bd545-c55a-4a6a-9cd8-0791f482fd59 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1226 microversion: 2.1 time: 0.090953 Sep 09 13:07:02.132698 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 517/1043] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:07:02 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:02.754995 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-73cfc448-f7fb-4b61-98ad-f1191b3036bb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:02.755700 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-73cfc448-f7fb-4b61-98ad-f1191b3036bb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:02.762379 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-73cfc448-f7fb-4b61-98ad-f1191b3036bb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:02.762882 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-73cfc448-f7fb-4b61-98ad-f1191b3036bb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:02.763317 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-73cfc448-f7fb-4b61-98ad-f1191b3036bb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:02.764003 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-73cfc448-f7fb-4b61-98ad-f1191b3036bb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:02.764457 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-73cfc448-f7fb-4b61-98ad-f1191b3036bb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:02.764884 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-73cfc448-f7fb-4b61-98ad-f1191b3036bb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:02.839208 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-73cfc448-f7fb-4b61-98ad-f1191b3036bb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:07:02.850105 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-73cfc448-f7fb-4b61-98ad-f1191b3036bb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4" status: 200 len: 1307 microversion: 2.1 time: 0.098269 Sep 09 13:07:02.850886 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 527/1044] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:07:02 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 => generated 1307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:03.156459 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-50e7f756-00ec-4a05-b8bf-125f5cd10de2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:03.157168 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-50e7f756-00ec-4a05-b8bf-125f5cd10de2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:03.164226 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-50e7f756-00ec-4a05-b8bf-125f5cd10de2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:03.167714 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-50e7f756-00ec-4a05-b8bf-125f5cd10de2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:03.167714 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-50e7f756-00ec-4a05-b8bf-125f5cd10de2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:03.167714 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-50e7f756-00ec-4a05-b8bf-125f5cd10de2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:03.167714 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-50e7f756-00ec-4a05-b8bf-125f5cd10de2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:03.168114 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-50e7f756-00ec-4a05-b8bf-125f5cd10de2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:03.199972 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-50e7f756-00ec-4a05-b8bf-125f5cd10de2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:03.200469 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-50e7f756-00ec-4a05-b8bf-125f5cd10de2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:03.200912 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-50e7f756-00ec-4a05-b8bf-125f5cd10de2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:03.201400 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.objects.instance [None req-50e7f756-00ec-4a05-b8bf-125f5cd10de2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lazy-loading 'fault' on Instance uuid 2a161d78-b95c-41f2-a747-3bc9376c5058 {{(pid=127772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:07:03.254078 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-50e7f756-00ec-4a05-b8bf-125f5cd10de2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c96322c48c146c7b8bcb9959f533820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427be7da6084e009b87ff500858cdc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:07:03.258533 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:07:03.264239 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-50e7f756-00ec-4a05-b8bf-125f5cd10de2 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 200 len: 1185 microversion: 2.1 time: 0.111646 Sep 09 13:07:03.280700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 518/1045] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:07:03 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 1185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:03.874467 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-b50dd957-0b9d-4204-adb6-ec6ad6ed6412 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:03.875275 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-b50dd957-0b9d-4204-adb6-ec6ad6ed6412 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:03.885965 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b50dd957-0b9d-4204-adb6-ec6ad6ed6412 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:03.886468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b50dd957-0b9d-4204-adb6-ec6ad6ed6412 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:03.887293 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b50dd957-0b9d-4204-adb6-ec6ad6ed6412 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:03.888175 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b50dd957-0b9d-4204-adb6-ec6ad6ed6412 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:03.888801 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b50dd957-0b9d-4204-adb6-ec6ad6ed6412 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:03.889383 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-b50dd957-0b9d-4204-adb6-ec6ad6ed6412 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:04.023976 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-b50dd957-0b9d-4204-adb6-ec6ad6ed6412 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:07:04.031325 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-b50dd957-0b9d-4204-adb6-ec6ad6ed6412 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4" status: 200 len: 1363 microversion: 2.1 time: 0.160829 Sep 09 13:07:04.031890 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 528/1046] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:07:03 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:04.288030 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7b46ddcd-17ab-4139-b01f-fb2a744ed619 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:04.288779 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7b46ddcd-17ab-4139-b01f-fb2a744ed619 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: 2a161d78-b95c-41f2-a747-3bc9376c5058] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:04.296597 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7b46ddcd-17ab-4139-b01f-fb2a744ed619 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:04.297088 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7b46ddcd-17ab-4139-b01f-fb2a744ed619 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:04.297535 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7b46ddcd-17ab-4139-b01f-fb2a744ed619 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:04.298237 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7b46ddcd-17ab-4139-b01f-fb2a744ed619 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:04.298729 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7b46ddcd-17ab-4139-b01f-fb2a744ed619 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:04.299163 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7b46ddcd-17ab-4139-b01f-fb2a744ed619 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:04.313367 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-7b46ddcd-17ab-4139-b01f-fb2a744ed619 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] HTTP exception thrown: Instance 2a161d78-b95c-41f2-a747-3bc9376c5058 could not be found. Sep 09 13:07:04.315376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7b46ddcd-17ab-4139-b01f-fb2a744ed619 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Request method failure captured: Sep 09 13:07:04.315376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 HTTP/1.1 Sep 09 13:07:04.315376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 13:07:04.315376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 13:07:04.315376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 13:07:04.315376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 13:07:04.315376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 13:07:04.315376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 13:07:04.315376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 13:07:04.315376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 13:07:04.315376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGziBp0TaRLVpJdvMiJoN5D3Evvin9QSbVm_yv3jhPeMQtBMG8G_NILBFPo_KFyNseqTRGO2R_1FlOV7avlgPxGwpBN-SPbr84YKCS2rLKsGdRwGlmBOnz8geOjbljkzC_ct6cP6NFHtKzPG0fVBpGHwLALPrywi42LSTd9vtyqG6ZR4 Sep 09 13:07:04.315376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 13:07:04.315376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 13:07:04.315376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 13:07:04.315376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 13:07:04.315376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 13:07:04.315376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 13:07:04.315376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: d427be7da6084e009b87ff500858cdc8 Sep 09 13:07:04.315376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-TestVolumeBootPattern-956018443 Sep 09 13:07:04.315376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 13:07:04.315376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 13:07:04.318098 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d427be7da6084e009b87ff500858cdc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d427be7da6084e009b87ff500858cdc8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d427be7da6084e009b87ff500858cdc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d427be7da6084e009b87ff500858cdc8"}]}] Sep 09 13:07:04.318098 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-TestVolumeBootPattern-956018443 Sep 09 13:07:04.318098 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: d427be7da6084e009b87ff500858cdc8 Sep 09 13:07:04.318098 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-TestVolumeBootPattern-956018443 Sep 09 13:07:04.318098 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-TestVolumeBootPattern-956018443-project Sep 09 13:07:04.318098 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 13:07:04.318098 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 13:07:04.318098 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: 4c96322c48c146c7b8bcb9959f533820 Sep 09 13:07:04.318098 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-TestVolumeBootPattern-956018443-project Sep 09 13:07:04.318098 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: > Sep 09 13:07:04.318098 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Instance 2a161d78-b95c-41f2-a747-3bc9376c5058 could not be found. Sep 09 13:07:04.318098 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'id': '2a161d78-b95c-41f2-a747-3bc9376c5058'} Sep 09 13:07:04.319630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:07:04.319630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:07:04.319630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:07:04.319630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:07:04.319630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:07:04.319630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:07:04.319630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:07:04.319630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:07:04.319630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:07:04.319630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:07:04.319630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a161d78-b95c-41f2-a747-3bc9376c5058 could not be found. Sep 09 13:07:04.319630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:07:04.319630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:07:04.319630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:07:04.319630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:07:04.319630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:07:04.319630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:07:04.319630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:07:04.319630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:07:04.319630 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:07:04.322026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:07:04.322026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:07:04.322026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:07:04.322026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:07:04.322026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:07:04.322026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:07:04.322026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:07:04.322026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a161d78-b95c-41f2-a747-3bc9376c5058 could not be found. Sep 09 13:07:04.322026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:07:04.322026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:07:04.322026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:07:04.322026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:07:04.322026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:07:04.322026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:07:04.322026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:07:04.322026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:07:04.322026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a161d78-b95c-41f2-a747-3bc9376c5058 could not be found. Sep 09 13:07:04.322026 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:07:04.324383 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7b46ddcd-17ab-4139-b01f-fb2a744ed619 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Returning 404 to user: Instance 2a161d78-b95c-41f2-a747-3bc9376c5058 could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:07:04.324383 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7b46ddcd-17ab-4139-b01f-fb2a744ed619 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058" status: 404 len: 111 microversion: 2.1 time: 0.032581 Sep 09 13:07:04.324383 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 519/1047] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:07:04 2022] GET /compute/v2.1/servers/2a161d78-b95c-41f2-a747-3bc9376c5058 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:07:04.693345 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-549cf435-81ea-4ec1-8690-1cec0b843dbe req-2d6ce1a9-16f8-4c6e-9120-803528325e1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9d25e47-5ea7-4711-ae33-cc707f9d18d4", "tag": "11585c2c-cd50-4a62-ba20-ca20269885b0"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:07:04.704005 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-549cf435-81ea-4ec1-8690-1cec0b843dbe req-2d6ce1a9-16f8-4c6e-9120-803528325e1f service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:04.704491 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-549cf435-81ea-4ec1-8690-1cec0b843dbe req-2d6ce1a9-16f8-4c6e-9120-803528325e1f service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:04.704924 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-549cf435-81ea-4ec1-8690-1cec0b843dbe req-2d6ce1a9-16f8-4c6e-9120-803528325e1f service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:04.716594 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-549cf435-81ea-4ec1-8690-1cec0b843dbe req-2d6ce1a9-16f8-4c6e-9120-803528325e1f service nova] Creating event network-changed:11585c2c-cd50-4a62-ba20-ca20269885b0 for instance a9d25e47-5ea7-4711-ae33-cc707f9d18d4 on hv-cinder-81322 Sep 09 13:07:04.725140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-549cf435-81ea-4ec1-8690-1cec0b843dbe req-2d6ce1a9-16f8-4c6e-9120-803528325e1f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032168 Sep 09 13:07:04.725140 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 529/1048] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:07:04.824626 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-79381ccc-bedb-4d98-b2c8-a931ca64239c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:04.825308 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-79381ccc-bedb-4d98-b2c8-a931ca64239c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:04.831323 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-79381ccc-bedb-4d98-b2c8-a931ca64239c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:04.831812 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-79381ccc-bedb-4d98-b2c8-a931ca64239c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:04.832335 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-79381ccc-bedb-4d98-b2c8-a931ca64239c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:04.832951 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-79381ccc-bedb-4d98-b2c8-a931ca64239c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:04.833572 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-79381ccc-bedb-4d98-b2c8-a931ca64239c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:04.834202 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-79381ccc-bedb-4d98-b2c8-a931ca64239c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:04.848545 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-79381ccc-bedb-4d98-b2c8-a931ca64239c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] HTTP exception thrown: Instance c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 could not be found. Sep 09 13:07:04.850198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-79381ccc-bedb-4d98-b2c8-a931ca64239c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Request method failure captured: Sep 09 13:07:04.850198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: DELETE /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 HTTP/1.1 Sep 09 13:07:04.850198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 13:07:04.850198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 13:07:04.850198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 13:07:04.850198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 13:07:04.850198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 13:07:04.850198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 13:07:04.850198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 13:07:04.850198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 13:07:04.850198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGziBp0TaRLVpJdvMiJoN5D3Evvin9QSbVm_yv3jhPeMQtBMG8G_NILBFPo_KFyNseqTRGO2R_1FlOV7avlgPxGwpBN-SPbr84YKCS2rLKsGdRwGlmBOnz8geOjbljkzC_ct6cP6NFHtKzPG0fVBpGHwLALPrywi42LSTd9vtyqG6ZR4 Sep 09 13:07:04.850198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 13:07:04.850198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 13:07:04.850198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 13:07:04.850198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 13:07:04.850198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 13:07:04.850198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 13:07:04.850198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: d427be7da6084e009b87ff500858cdc8 Sep 09 13:07:04.850198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-TestVolumeBootPattern-956018443 Sep 09 13:07:04.850198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 13:07:04.850198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 13:07:04.851847 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d427be7da6084e009b87ff500858cdc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d427be7da6084e009b87ff500858cdc8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d427be7da6084e009b87ff500858cdc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d427be7da6084e009b87ff500858cdc8"}]}] Sep 09 13:07:04.851847 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-TestVolumeBootPattern-956018443 Sep 09 13:07:04.851847 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: d427be7da6084e009b87ff500858cdc8 Sep 09 13:07:04.851847 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-TestVolumeBootPattern-956018443 Sep 09 13:07:04.851847 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-TestVolumeBootPattern-956018443-project Sep 09 13:07:04.851847 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 13:07:04.851847 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 13:07:04.851847 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: 4c96322c48c146c7b8bcb9959f533820 Sep 09 13:07:04.851847 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-TestVolumeBootPattern-956018443-project Sep 09 13:07:04.851847 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: > Sep 09 13:07:04.851847 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Instance c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 could not be found. Sep 09 13:07:04.851847 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'id': 'c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87'} Sep 09 13:07:04.852690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:07:04.852690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:07:04.852690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:07:04.852690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:07:04.852690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:07:04.852690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:07:04.852690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:07:04.852690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:07:04.852690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:07:04.852690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:07:04.852690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 could not be found. Sep 09 13:07:04.852690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:07:04.852690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:07:04.852690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:07:04.852690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:07:04.852690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:07:04.852690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:07:04.852690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:07:04.852690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:07:04.852690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:07:04.854006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:07:04.854006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 13:07:04.854006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 13:07:04.854006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 13:07:04.854006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 13:07:04.854006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:07:04.854006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:07:04.854006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:07:04.854006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:07:04.854006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 could not be found. Sep 09 13:07:04.854006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:07:04.854006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:07:04.854006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:07:04.854006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:07:04.854006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:07:04.854006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:07:04.854006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:07:04.854006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:07:04.854006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 could not be found. Sep 09 13:07:04.854006 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:07:04.855327 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-79381ccc-bedb-4d98-b2c8-a931ca64239c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Returning 404 to user: Instance c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:07:04.855327 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-79381ccc-bedb-4d98-b2c8-a931ca64239c tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 404 len: 111 microversion: 2.1 time: 0.032220 Sep 09 13:07:04.855327 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 520/1049] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:07:04 2022] DELETE /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 13:07:04.861654 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0e317391-0592-4c45-be9b-c1c4c917e0c3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:04.862434 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-0e317391-0592-4c45-be9b-c1c4c917e0c3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] [instance: c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:04.869222 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0e317391-0592-4c45-be9b-c1c4c917e0c3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:04.870258 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0e317391-0592-4c45-be9b-c1c4c917e0c3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:04.870738 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0e317391-0592-4c45-be9b-c1c4c917e0c3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:04.871493 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0e317391-0592-4c45-be9b-c1c4c917e0c3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:04.874611 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0e317391-0592-4c45-be9b-c1c4c917e0c3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:04.874611 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0e317391-0592-4c45-be9b-c1c4c917e0c3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:04.887592 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-0e317391-0592-4c45-be9b-c1c4c917e0c3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] HTTP exception thrown: Instance c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 could not be found. Sep 09 13:07:04.889250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0e317391-0592-4c45-be9b-c1c4c917e0c3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Request method failure captured: Sep 09 13:07:04.889250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 HTTP/1.1 Sep 09 13:07:04.889250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:07:04.889250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:07:04.889250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:07:04.889250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:07:04.889250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:07:04.889250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:07:04.889250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:07:04.889250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:07:04.889250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGziBp0TaRLVpJdvMiJoN5D3Evvin9QSbVm_yv3jhPeMQtBMG8G_NILBFPo_KFyNseqTRGO2R_1FlOV7avlgPxGwpBN-SPbr84YKCS2rLKsGdRwGlmBOnz8geOjbljkzC_ct6cP6NFHtKzPG0fVBpGHwLALPrywi42LSTd9vtyqG6ZR4 Sep 09 13:07:04.889250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:07:04.889250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:07:04.889250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:07:04.889250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:07:04.889250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:07:04.889250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:07:04.889250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: d427be7da6084e009b87ff500858cdc8 Sep 09 13:07:04.889250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-TestVolumeBootPattern-956018443 Sep 09 13:07:04.889250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:07:04.889250 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:07:04.891095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d427be7da6084e009b87ff500858cdc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d427be7da6084e009b87ff500858cdc8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d427be7da6084e009b87ff500858cdc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d427be7da6084e009b87ff500858cdc8"}]}] Sep 09 13:07:04.891095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-TestVolumeBootPattern-956018443 Sep 09 13:07:04.891095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: d427be7da6084e009b87ff500858cdc8 Sep 09 13:07:04.891095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-TestVolumeBootPattern-956018443 Sep 09 13:07:04.891095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-TestVolumeBootPattern-956018443-project Sep 09 13:07:04.891095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:07:04.891095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:07:04.891095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 4c96322c48c146c7b8bcb9959f533820 Sep 09 13:07:04.891095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-TestVolumeBootPattern-956018443-project Sep 09 13:07:04.891095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:07:04.891095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 could not be found. Sep 09 13:07:04.891095 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': 'c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87'} Sep 09 13:07:04.895131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:07:04.895131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:07:04.895131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:07:04.895131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:07:04.895131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:07:04.895131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:07:04.895131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:07:04.895131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:07:04.895131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:07:04.895131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:07:04.895131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 could not be found. Sep 09 13:07:04.895131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:07:04.895131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:07:04.895131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:07:04.895131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:07:04.895131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:07:04.895131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:07:04.895131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:07:04.895131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:07:04.895131 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:07:04.896629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:07:04.896629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:07:04.896629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:07:04.896629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:07:04.896629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:07:04.896629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:07:04.896629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:07:04.896629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 could not be found. Sep 09 13:07:04.896629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:07:04.896629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:07:04.896629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:07:04.896629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:07:04.896629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:07:04.896629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:07:04.896629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:07:04.896629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:07:04.896629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 could not be found. Sep 09 13:07:04.896629 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:07:04.897933 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0e317391-0592-4c45-be9b-c1c4c917e0c3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Returning 404 to user: Instance c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:07:04.897933 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0e317391-0592-4c45-be9b-c1c4c917e0c3 tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87" status: 404 len: 111 microversion: 2.1 time: 0.033294 Sep 09 13:07:04.897933 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 530/1050] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:07:04 2022] GET /compute/v2.1/servers/c02f61c3-e3b9-4b75-887c-9c3f9f6a7a87 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:07:05.055655 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-a12f96c9-66f2-443f-b22e-bc3774bf23a3 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:05.056275 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-a12f96c9-66f2-443f-b22e-bc3774bf23a3 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:05.063148 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a12f96c9-66f2-443f-b22e-bc3774bf23a3 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:05.063638 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a12f96c9-66f2-443f-b22e-bc3774bf23a3 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:05.064183 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a12f96c9-66f2-443f-b22e-bc3774bf23a3 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:05.064864 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a12f96c9-66f2-443f-b22e-bc3774bf23a3 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:05.065332 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a12f96c9-66f2-443f-b22e-bc3774bf23a3 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:05.065759 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-a12f96c9-66f2-443f-b22e-bc3774bf23a3 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:05.292512 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-a12f96c9-66f2-443f-b22e-bc3774bf23a3 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:07:05.300971 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-a12f96c9-66f2-443f-b22e-bc3774bf23a3 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4" status: 200 len: 1363 microversion: 2.1 time: 0.249458 Sep 09 13:07:05.301708 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 521/1051] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:07:05 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:06.324731 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2f78b3e8-3afd-4dcc-a471-9a1da3f44a23 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:06.325343 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2f78b3e8-3afd-4dcc-a471-9a1da3f44a23 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:06.332175 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2f78b3e8-3afd-4dcc-a471-9a1da3f44a23 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:06.332654 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2f78b3e8-3afd-4dcc-a471-9a1da3f44a23 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:06.333271 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2f78b3e8-3afd-4dcc-a471-9a1da3f44a23 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:06.334325 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2f78b3e8-3afd-4dcc-a471-9a1da3f44a23 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:06.334812 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2f78b3e8-3afd-4dcc-a471-9a1da3f44a23 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:06.335235 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2f78b3e8-3afd-4dcc-a471-9a1da3f44a23 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:06.434146 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-3583ff9a-5ef4-4741-9df9-ca07d2a5df1e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] Calling method '.version_select at 0x7f3182e87b80>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:06.490089 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2f78b3e8-3afd-4dcc-a471-9a1da3f44a23 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:07:06.498728 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2f78b3e8-3afd-4dcc-a471-9a1da3f44a23 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4" status: 200 len: 1363 microversion: 2.1 time: 0.178680 Sep 09 13:07:06.499456 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 531/1052] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:07:06 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:06.517511 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-3583ff9a-5ef4-4741-9df9-ca07d2a5df1e tempest-TestVolumeBootPattern-956018443 tempest-TestVolumeBootPattern-956018443-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1884139847" status: 202 len: 0 microversion: 2.1 time: 0.088616 Sep 09 13:07:06.518087 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 522/1053] 10.222.0.46 () {58 vars in 1263 bytes} [Fri Sep 9 13:07:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1884139847 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:07:07.521134 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-36c0b7ae-67ee-4f62-a0fb-8997ec105992 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:07.521917 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-36c0b7ae-67ee-4f62-a0fb-8997ec105992 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:07.529344 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-36c0b7ae-67ee-4f62-a0fb-8997ec105992 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:07.530375 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-36c0b7ae-67ee-4f62-a0fb-8997ec105992 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:07.530375 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-36c0b7ae-67ee-4f62-a0fb-8997ec105992 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:07.531920 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-36c0b7ae-67ee-4f62-a0fb-8997ec105992 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:07.531920 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-36c0b7ae-67ee-4f62-a0fb-8997ec105992 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:07.531920 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-36c0b7ae-67ee-4f62-a0fb-8997ec105992 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:07.762632 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-36c0b7ae-67ee-4f62-a0fb-8997ec105992 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:07:07.770335 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-36c0b7ae-67ee-4f62-a0fb-8997ec105992 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4" status: 200 len: 1363 microversion: 2.1 time: 0.253035 Sep 09 13:07:07.771103 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 532/1054] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:07:07 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:08.794712 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e93c978e-ccc4-4b01-a748-502e12bb99bb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:08.795432 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e93c978e-ccc4-4b01-a748-502e12bb99bb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:08.803471 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e93c978e-ccc4-4b01-a748-502e12bb99bb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:08.804178 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e93c978e-ccc4-4b01-a748-502e12bb99bb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:08.804756 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e93c978e-ccc4-4b01-a748-502e12bb99bb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:08.805475 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e93c978e-ccc4-4b01-a748-502e12bb99bb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:08.805933 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e93c978e-ccc4-4b01-a748-502e12bb99bb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:08.806358 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e93c978e-ccc4-4b01-a748-502e12bb99bb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:08.972857 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e93c978e-ccc4-4b01-a748-502e12bb99bb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:07:08.981529 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e93c978e-ccc4-4b01-a748-502e12bb99bb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4" status: 200 len: 1363 microversion: 2.1 time: 0.192147 Sep 09 13:07:08.984446 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 523/1055] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:07:08 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:10.007460 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-624b356f-e36b-467a-b77e-411c6f268d57 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:10.008398 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-624b356f-e36b-467a-b77e-411c6f268d57 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:10.018454 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-624b356f-e36b-467a-b77e-411c6f268d57 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:10.019008 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-624b356f-e36b-467a-b77e-411c6f268d57 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:10.019697 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-624b356f-e36b-467a-b77e-411c6f268d57 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:10.020489 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-624b356f-e36b-467a-b77e-411c6f268d57 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:10.021021 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-624b356f-e36b-467a-b77e-411c6f268d57 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:10.021525 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-624b356f-e36b-467a-b77e-411c6f268d57 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:10.032735 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:07:10.255441 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-624b356f-e36b-467a-b77e-411c6f268d57 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:07:10.264534 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-624b356f-e36b-467a-b77e-411c6f268d57 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4" status: 200 len: 1363 microversion: 2.1 time: 0.261589 Sep 09 13:07:10.265636 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 533/1056] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:07:10 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:10.766368 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-19f7b54d-4345-431e-8300-f113ae9e8f64 req-21e83f14-b0bf-441e-b834-cd77cbd9c947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9d25e47-5ea7-4711-ae33-cc707f9d18d4", "name": "network-vif-plugged", "status": "completed", "tag": "11585c2c-cd50-4a62-ba20-ca20269885b0"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:07:10.772342 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=2 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:07:10.773219 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=6 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:07:10.779391 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-19f7b54d-4345-431e-8300-f113ae9e8f64 req-21e83f14-b0bf-441e-b834-cd77cbd9c947 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:10.779900 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-19f7b54d-4345-431e-8300-f113ae9e8f64 req-21e83f14-b0bf-441e-b834-cd77cbd9c947 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:10.780353 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-19f7b54d-4345-431e-8300-f113ae9e8f64 req-21e83f14-b0bf-441e-b834-cd77cbd9c947 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:10.792247 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-19f7b54d-4345-431e-8300-f113ae9e8f64 req-21e83f14-b0bf-441e-b834-cd77cbd9c947 service nova] Creating event network-vif-plugged:11585c2c-cd50-4a62-ba20-ca20269885b0 for instance a9d25e47-5ea7-4711-ae33-cc707f9d18d4 on hv-cinder-81322 Sep 09 13:07:10.797358 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-19f7b54d-4345-431e-8300-f113ae9e8f64 req-21e83f14-b0bf-441e-b834-cd77cbd9c947 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034825 Sep 09 13:07:10.797955 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 524/1057] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:07:11.288187 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-76125ac3-8f75-439e-bb0a-33953996e06e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:11.288901 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-76125ac3-8f75-439e-bb0a-33953996e06e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:11.290884 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=6 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:07:11.296924 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-76125ac3-8f75-439e-bb0a-33953996e06e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:11.297396 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-76125ac3-8f75-439e-bb0a-33953996e06e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:11.297830 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-76125ac3-8f75-439e-bb0a-33953996e06e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:11.298550 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-76125ac3-8f75-439e-bb0a-33953996e06e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:11.299003 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-76125ac3-8f75-439e-bb0a-33953996e06e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:11.299430 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-76125ac3-8f75-439e-bb0a-33953996e06e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:11.441435 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-76125ac3-8f75-439e-bb0a-33953996e06e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:07:11.456936 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-76125ac3-8f75-439e-bb0a-33953996e06e tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4" status: 200 len: 1363 microversion: 2.1 time: 0.172865 Sep 09 13:07:11.457913 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 534/1058] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:07:11 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:12.482837 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-220613c1-6a0e-40c7-b5ff-d1066e64dac8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:12.483495 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-220613c1-6a0e-40c7-b5ff-d1066e64dac8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:12.491809 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-220613c1-6a0e-40c7-b5ff-d1066e64dac8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:12.492297 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-220613c1-6a0e-40c7-b5ff-d1066e64dac8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:12.492777 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-220613c1-6a0e-40c7-b5ff-d1066e64dac8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:12.493544 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-220613c1-6a0e-40c7-b5ff-d1066e64dac8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:12.494002 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-220613c1-6a0e-40c7-b5ff-d1066e64dac8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:12.494527 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-220613c1-6a0e-40c7-b5ff-d1066e64dac8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:12.693476 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-220613c1-6a0e-40c7-b5ff-d1066e64dac8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:07:12.714568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-220613c1-6a0e-40c7-b5ff-d1066e64dac8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4" status: 200 len: 1363 microversion: 2.1 time: 0.225116 Sep 09 13:07:12.714568 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 525/1059] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:07:12 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:13.727223 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0ee3104a-b24b-4f20-8a3d-dc41b9823789 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:13.727968 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-0ee3104a-b24b-4f20-8a3d-dc41b9823789 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:13.738984 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0ee3104a-b24b-4f20-8a3d-dc41b9823789 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:13.739476 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0ee3104a-b24b-4f20-8a3d-dc41b9823789 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:13.739968 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0ee3104a-b24b-4f20-8a3d-dc41b9823789 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:13.740677 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0ee3104a-b24b-4f20-8a3d-dc41b9823789 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:13.741126 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0ee3104a-b24b-4f20-8a3d-dc41b9823789 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:13.741576 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0ee3104a-b24b-4f20-8a3d-dc41b9823789 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:13.897440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-0ee3104a-b24b-4f20-8a3d-dc41b9823789 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:07:13.906328 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0ee3104a-b24b-4f20-8a3d-dc41b9823789 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4" status: 200 len: 1548 microversion: 2.1 time: 0.183307 Sep 09 13:07:13.906953 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 535/1060] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:07:13 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 => generated 1548 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:13.930079 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-f3d20599-dd05-49a0-9ef7-2d75d086e6f0 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:13.930700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-f3d20599-dd05-49a0-9ef7-2d75d086e6f0 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:13.937879 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f3d20599-dd05-49a0-9ef7-2d75d086e6f0 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:13.938372 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f3d20599-dd05-49a0-9ef7-2d75d086e6f0 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:13.938856 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f3d20599-dd05-49a0-9ef7-2d75d086e6f0 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:13.939564 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f3d20599-dd05-49a0-9ef7-2d75d086e6f0 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:13.940023 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f3d20599-dd05-49a0-9ef7-2d75d086e6f0 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:13.940456 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-f3d20599-dd05-49a0-9ef7-2d75d086e6f0 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:14.048892 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-f3d20599-dd05-49a0-9ef7-2d75d086e6f0 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121716 Sep 09 13:07:14.056244 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 526/1061] 10.222.0.46 () {58 vars in 1275 bytes} [Fri Sep 9 13:07:13 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:07:15.070810 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-218c3ae2-5003-4b0d-a8cd-07360db745d6 req-14cd7be6-873e-47a9-a953-439705dcdd15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9d25e47-5ea7-4711-ae33-cc707f9d18d4", "tag": "11585c2c-cd50-4a62-ba20-ca20269885b0"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:07:15.080253 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-218c3ae2-5003-4b0d-a8cd-07360db745d6 req-14cd7be6-873e-47a9-a953-439705dcdd15 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:15.080740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-218c3ae2-5003-4b0d-a8cd-07360db745d6 req-14cd7be6-873e-47a9-a953-439705dcdd15 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:15.081183 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-218c3ae2-5003-4b0d-a8cd-07360db745d6 req-14cd7be6-873e-47a9-a953-439705dcdd15 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:15.092850 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-218c3ae2-5003-4b0d-a8cd-07360db745d6 req-14cd7be6-873e-47a9-a953-439705dcdd15 service nova] Creating event network-changed:11585c2c-cd50-4a62-ba20-ca20269885b0 for instance a9d25e47-5ea7-4711-ae33-cc707f9d18d4 on hv-cinder-81322 Sep 09 13:07:15.098369 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-218c3ae2-5003-4b0d-a8cd-07360db745d6 req-14cd7be6-873e-47a9-a953-439705dcdd15 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031629 Sep 09 13:07:15.099185 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 536/1062] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:07:26.481915 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:07:26.482774 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=28 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:07:26.484749 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:07:26.485639 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=18 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:07:26.486841 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-da316e4d-79e3-4bc8-b492-2cfd81c9cb42 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:26.487348 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-da316e4d-79e3-4bc8-b492-2cfd81c9cb42 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:26.489752 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-5c8848b9-f8e5-4c5f-9a91-f3344ed90262 req-ecbc427c-dd61-401d-9e39-f3a65d141555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10884cc0-9f01-425e-8d5f-9e0727a68b5e", "tag": "b5735773-f9c8-4cb1-80c8-146eef0519fe"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:07:26.493529 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-da316e4d-79e3-4bc8-b492-2cfd81c9cb42 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:26.494642 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-da316e4d-79e3-4bc8-b492-2cfd81c9cb42 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:26.494642 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-da316e4d-79e3-4bc8-b492-2cfd81c9cb42 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:26.495498 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-da316e4d-79e3-4bc8-b492-2cfd81c9cb42 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:26.495967 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-da316e4d-79e3-4bc8-b492-2cfd81c9cb42 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:26.496406 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-da316e4d-79e3-4bc8-b492-2cfd81c9cb42 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:26.501833 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-5c8848b9-f8e5-4c5f-9a91-f3344ed90262 req-ecbc427c-dd61-401d-9e39-f3a65d141555 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:26.502317 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-5c8848b9-f8e5-4c5f-9a91-f3344ed90262 req-ecbc427c-dd61-401d-9e39-f3a65d141555 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:26.502780 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-5c8848b9-f8e5-4c5f-9a91-f3344ed90262 req-ecbc427c-dd61-401d-9e39-f3a65d141555 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:26.514442 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-5c8848b9-f8e5-4c5f-9a91-f3344ed90262 req-ecbc427c-dd61-401d-9e39-f3a65d141555 service nova] Creating event network-changed:b5735773-f9c8-4cb1-80c8-146eef0519fe for instance 10884cc0-9f01-425e-8d5f-9e0727a68b5e on hv-cinder-81322 Sep 09 13:07:26.519470 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-5c8848b9-f8e5-4c5f-9a91-f3344ed90262 req-ecbc427c-dd61-401d-9e39-f3a65d141555 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036607 Sep 09 13:07:26.520432 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 537/1063] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:07:26.537876 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-da316e4d-79e3-4bc8-b492-2cfd81c9cb42 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Going to try to terminate instance {{(pid=127772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:07:26.850777 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-da316e4d-79e3-4bc8-b492-2cfd81c9cb42 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "DELETE /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 204 len: 0 microversion: 2.1 time: 0.370453 Sep 09 13:07:26.851672 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 527/1064] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:07:26 2022] DELETE /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:07:26.861467 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-80901f1e-81dc-481c-bebd-fd93c37829ce tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:26.862316 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-80901f1e-81dc-481c-bebd-fd93c37829ce tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:26.869878 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-80901f1e-81dc-481c-bebd-fd93c37829ce tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:26.870530 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-80901f1e-81dc-481c-bebd-fd93c37829ce tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:26.871080 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-80901f1e-81dc-481c-bebd-fd93c37829ce tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:26.872548 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-80901f1e-81dc-481c-bebd-fd93c37829ce tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:26.873438 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-80901f1e-81dc-481c-bebd-fd93c37829ce tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:26.873972 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-80901f1e-81dc-481c-bebd-fd93c37829ce tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:27.016959 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-80901f1e-81dc-481c-bebd-fd93c37829ce tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:07:27.024774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-80901f1e-81dc-481c-bebd-fd93c37829ce tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1568 microversion: 2.1 time: 0.167856 Sep 09 13:07:27.025337 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 538/1065] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:07:26 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:28.050399 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-1493b286-c508-45ba-a887-72d4556d34d7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:28.051189 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-1493b286-c508-45ba-a887-72d4556d34d7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:28.058781 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1493b286-c508-45ba-a887-72d4556d34d7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:28.059903 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1493b286-c508-45ba-a887-72d4556d34d7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:28.060418 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1493b286-c508-45ba-a887-72d4556d34d7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:28.061129 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1493b286-c508-45ba-a887-72d4556d34d7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:28.061626 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1493b286-c508-45ba-a887-72d4556d34d7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:28.062056 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1493b286-c508-45ba-a887-72d4556d34d7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:28.195591 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-1493b286-c508-45ba-a887-72d4556d34d7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:07:28.203674 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-1493b286-c508-45ba-a887-72d4556d34d7 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1568 microversion: 2.1 time: 0.158000 Sep 09 13:07:28.204243 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 528/1066] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:07:28 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:28.889625 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-0edbf28a-adb5-45d9-b6e1-b9c129d75ee8 req-2eb81fb8-9679-4f9c-83c1-deaec2e537a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10884cc0-9f01-425e-8d5f-9e0727a68b5e", "name": "network-vif-deleted", "tag": "b5735773-f9c8-4cb1-80c8-146eef0519fe"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:07:28.899887 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-0edbf28a-adb5-45d9-b6e1-b9c129d75ee8 req-2eb81fb8-9679-4f9c-83c1-deaec2e537a3 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:28.904086 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-0edbf28a-adb5-45d9-b6e1-b9c129d75ee8 req-2eb81fb8-9679-4f9c-83c1-deaec2e537a3 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:28.904086 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-0edbf28a-adb5-45d9-b6e1-b9c129d75ee8 req-2eb81fb8-9679-4f9c-83c1-deaec2e537a3 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:28.913494 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-0edbf28a-adb5-45d9-b6e1-b9c129d75ee8 req-2eb81fb8-9679-4f9c-83c1-deaec2e537a3 service nova] Creating event network-vif-deleted:b5735773-f9c8-4cb1-80c8-146eef0519fe for instance 10884cc0-9f01-425e-8d5f-9e0727a68b5e on hv-cinder-81322 Sep 09 13:07:28.920862 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-0edbf28a-adb5-45d9-b6e1-b9c129d75ee8 req-2eb81fb8-9679-4f9c-83c1-deaec2e537a3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035366 Sep 09 13:07:28.921534 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 539/1067] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:07:29.227555 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e4ded050-5ce8-4b9b-b171-3ba7084005cf tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:29.231748 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e4ded050-5ce8-4b9b-b171-3ba7084005cf tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:29.235251 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e4ded050-5ce8-4b9b-b171-3ba7084005cf tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:29.235708 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e4ded050-5ce8-4b9b-b171-3ba7084005cf tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:29.236259 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e4ded050-5ce8-4b9b-b171-3ba7084005cf tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:29.236970 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e4ded050-5ce8-4b9b-b171-3ba7084005cf tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:29.237422 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e4ded050-5ce8-4b9b-b171-3ba7084005cf tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:29.237861 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e4ded050-5ce8-4b9b-b171-3ba7084005cf tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:29.303798 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-e4ded050-5ce8-4b9b-b171-3ba7084005cf tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:07:29.312529 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e4ded050-5ce8-4b9b-b171-3ba7084005cf tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1220 microversion: 2.1 time: 0.089213 Sep 09 13:07:29.313108 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 529/1068] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:07:29 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:30.341482 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8753dbe6-9c1b-40bc-8d8c-12b5882ea92c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:30.342109 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-8753dbe6-9c1b-40bc-8d8c-12b5882ea92c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:30.348465 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8753dbe6-9c1b-40bc-8d8c-12b5882ea92c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:30.348951 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8753dbe6-9c1b-40bc-8d8c-12b5882ea92c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:30.349400 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8753dbe6-9c1b-40bc-8d8c-12b5882ea92c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:30.350087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8753dbe6-9c1b-40bc-8d8c-12b5882ea92c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:30.350573 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8753dbe6-9c1b-40bc-8d8c-12b5882ea92c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:30.351005 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8753dbe6-9c1b-40bc-8d8c-12b5882ea92c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:30.383536 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8753dbe6-9c1b-40bc-8d8c-12b5882ea92c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:30.384025 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8753dbe6-9c1b-40bc-8d8c-12b5882ea92c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:30.384462 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8753dbe6-9c1b-40bc-8d8c-12b5882ea92c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:30.384909 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.objects.instance [None req-8753dbe6-9c1b-40bc-8d8c-12b5882ea92c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lazy-loading 'fault' on Instance uuid 10884cc0-9f01-425e-8d5f-9e0727a68b5e {{(pid=127771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:07:30.664014 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-8753dbe6-9c1b-40bc-8d8c-12b5882ea92c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112ff54558147cf8739322b085fe1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add9aa988a0848d185d4f06039cfd00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:07:30.672270 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-8753dbe6-9c1b-40bc-8d8c-12b5882ea92c tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 200 len: 1179 microversion: 2.1 time: 0.336429 Sep 09 13:07:30.672838 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 540/1069] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:07:30 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 1179 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:31.919262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e08b2191-7824-4029-9cd7-919b2e477c88 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:31.919877 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-e08b2191-7824-4029-9cd7-919b2e477c88 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] [instance: 10884cc0-9f01-425e-8d5f-9e0727a68b5e] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:31.925651 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e08b2191-7824-4029-9cd7-919b2e477c88 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:31.926125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e08b2191-7824-4029-9cd7-919b2e477c88 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:31.926591 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e08b2191-7824-4029-9cd7-919b2e477c88 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:31.927276 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e08b2191-7824-4029-9cd7-919b2e477c88 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:31.927728 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e08b2191-7824-4029-9cd7-919b2e477c88 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:31.928149 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-e08b2191-7824-4029-9cd7-919b2e477c88 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:31.941083 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-e08b2191-7824-4029-9cd7-919b2e477c88 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] HTTP exception thrown: Instance 10884cc0-9f01-425e-8d5f-9e0727a68b5e could not be found. Sep 09 13:07:31.942730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e08b2191-7824-4029-9cd7-919b2e477c88 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Request method failure captured: Sep 09 13:07:31.942730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e HTTP/1.1 Sep 09 13:07:31.942730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 13:07:31.942730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 13:07:31.942730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 13:07:31.942730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 13:07:31.942730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 13:07:31.942730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 13:07:31.942730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 13:07:31.942730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 13:07:31.942730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGzlfEQBXEPjjt7DZ1FOXv_ofL4xYLUHEXJKoev7nmFKNGJwNJfCMONrBFleWAF_wY99lWtUAV5QFjTPgtRh8vPvJOjEHDvWe24qVAHGTGGBOpm8yMVg34lep9yRQZbcGnJXhNVL-rfmcSpO5bRPjGa8G7ABzKWyJ-rxYT151ugKIgkE Sep 09 13:07:31.942730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 13:07:31.942730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 13:07:31.942730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 13:07:31.942730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 13:07:31.942730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 13:07:31.942730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 13:07:31.942730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: add9aa988a0848d185d4f06039cfd00e Sep 09 13:07:31.942730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-TestShelveInstance-1908367894 Sep 09 13:07:31.942730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 13:07:31.942730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 13:07:31.944410 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/add9aa988a0848d185d4f06039cfd00e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_add9aa988a0848d185d4f06039cfd00e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/add9aa988a0848d185d4f06039cfd00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/add9aa988a0848d185d4f06039cfd00e"}]}] Sep 09 13:07:31.944410 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-TestShelveInstance-1908367894 Sep 09 13:07:31.944410 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: add9aa988a0848d185d4f06039cfd00e Sep 09 13:07:31.944410 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-TestShelveInstance-1908367894 Sep 09 13:07:31.944410 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-TestShelveInstance-1908367894-project Sep 09 13:07:31.944410 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 13:07:31.944410 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 13:07:31.944410 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: a112ff54558147cf8739322b085fe1ab Sep 09 13:07:31.944410 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-TestShelveInstance-1908367894-project Sep 09 13:07:31.944410 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: > Sep 09 13:07:31.944410 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Instance 10884cc0-9f01-425e-8d5f-9e0727a68b5e could not be found. Sep 09 13:07:31.944410 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'id': '10884cc0-9f01-425e-8d5f-9e0727a68b5e'} Sep 09 13:07:31.945378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:07:31.945378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:07:31.945378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:07:31.945378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:07:31.945378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:07:31.945378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:07:31.945378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:07:31.945378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:07:31.945378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:07:31.945378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:07:31.945378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10884cc0-9f01-425e-8d5f-9e0727a68b5e could not be found. Sep 09 13:07:31.945378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:07:31.945378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:07:31.945378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:07:31.945378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:07:31.945378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:07:31.945378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:07:31.945378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:07:31.945378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:07:31.945378 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:07:31.946981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:07:31.946981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:07:31.946981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:07:31.946981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:07:31.946981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:07:31.946981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:07:31.946981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:07:31.946981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10884cc0-9f01-425e-8d5f-9e0727a68b5e could not be found. Sep 09 13:07:31.946981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:07:31.946981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:07:31.946981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:07:31.946981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:07:31.946981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:07:31.946981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:07:31.946981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:07:31.946981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:07:31.946981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10884cc0-9f01-425e-8d5f-9e0727a68b5e could not be found. Sep 09 13:07:31.946981 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:07:31.948360 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-e08b2191-7824-4029-9cd7-919b2e477c88 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Returning 404 to user: Instance 10884cc0-9f01-425e-8d5f-9e0727a68b5e could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:07:31.948360 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-e08b2191-7824-4029-9cd7-919b2e477c88 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e" status: 404 len: 111 microversion: 2.1 time: 0.248556 Sep 09 13:07:31.948360 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 530/1070] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:07:31 2022] GET /compute/v2.1/servers/10884cc0-9f01-425e-8d5f-9e0727a68b5e => generated 111 bytes in 250 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:07:32.192399 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-bea85a38-c5ee-4345-b97b-f7042c47b221 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] Calling method '.version_select at 0x7f3183228c10>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:32.267824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-bea85a38-c5ee-4345-b97b-f7042c47b221 tempest-TestShelveInstance-1908367894 tempest-TestShelveInstance-1908367894-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2050944839" status: 202 len: 0 microversion: 2.1 time: 0.079480 Sep 09 13:07:32.268346 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 541/1071] 10.222.0.46 () {58 vars in 1254 bytes} [Fri Sep 9 13:07:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2050944839 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:07:49.365230 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-b4cc5972-1b03-40ce-bc8a-ee2642cd8924 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:49.365790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-b4cc5972-1b03-40ce-bc8a-ee2642cd8924 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:49.368265 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:07:49.369081 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:07:49.374074 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b4cc5972-1b03-40ce-bc8a-ee2642cd8924 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:49.374521 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b4cc5972-1b03-40ce-bc8a-ee2642cd8924 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:49.374957 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b4cc5972-1b03-40ce-bc8a-ee2642cd8924 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:49.375646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b4cc5972-1b03-40ce-bc8a-ee2642cd8924 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:49.376103 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b4cc5972-1b03-40ce-bc8a-ee2642cd8924 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:49.376528 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-b4cc5972-1b03-40ce-bc8a-ee2642cd8924 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:49.400600 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-b4cc5972-1b03-40ce-bc8a-ee2642cd8924 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/ips" status: 200 len: 144 microversion: 2.1 time: 0.039234 Sep 09 13:07:49.401169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 531/1072] 10.222.0.46 () {58 vars in 1248 bytes} [Fri Sep 9 13:07:49 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/ips => generated 144 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:07:51.060259 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-4e4f9e16-9c70-479d-b3f5-e656fb24cda9 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8600d035-2e6e-45b2-9933-77248fad8e1a"}} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:07:51.062605 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-4e4f9e16-9c70-479d-b3f5-e656fb24cda9 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:51.064842 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=18 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:07:51.065505 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:07:51.070973 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4e4f9e16-9c70-479d-b3f5-e656fb24cda9 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:51.071469 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4e4f9e16-9c70-479d-b3f5-e656fb24cda9 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:51.071920 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4e4f9e16-9c70-479d-b3f5-e656fb24cda9 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:51.072628 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4e4f9e16-9c70-479d-b3f5-e656fb24cda9 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:51.073090 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4e4f9e16-9c70-479d-b3f5-e656fb24cda9 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:51.073524 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4e4f9e16-9c70-479d-b3f5-e656fb24cda9 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:51.741644 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-4e4f9e16-9c70-479d-b3f5-e656fb24cda9 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "POST /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.685835 Sep 09 13:07:51.742252 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 542/1073] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 13:07:51 2022] POST /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-volume_attachments => generated 194 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:07:59.279708 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7f303759-20cb-4c39-b012-6e11f9a280d8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:59.282647 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7f303759-20cb-4c39-b012-6e11f9a280d8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:59.289733 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7f303759-20cb-4c39-b012-6e11f9a280d8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:59.290254 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7f303759-20cb-4c39-b012-6e11f9a280d8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:59.290731 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7f303759-20cb-4c39-b012-6e11f9a280d8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:59.291430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7f303759-20cb-4c39-b012-6e11f9a280d8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:59.291902 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7f303759-20cb-4c39-b012-6e11f9a280d8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:59.292332 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7f303759-20cb-4c39-b012-6e11f9a280d8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:59.321836 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7f303759-20cb-4c39-b012-6e11f9a280d8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046620 Sep 09 13:07:59.322396 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 532/1074] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:07:59 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:07:59.335289 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-9517f519-78cd-4da5-b663-2a30f40233ec tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:59.335941 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-9517f519-78cd-4da5-b663-2a30f40233ec tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:07:59.342230 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9517f519-78cd-4da5-b663-2a30f40233ec tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:59.342852 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9517f519-78cd-4da5-b663-2a30f40233ec tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:59.343344 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9517f519-78cd-4da5-b663-2a30f40233ec tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:59.344008 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9517f519-78cd-4da5-b663-2a30f40233ec tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:07:59.344479 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9517f519-78cd-4da5-b663-2a30f40233ec tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:07:59.344916 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-9517f519-78cd-4da5-b663-2a30f40233ec tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:07:59.374414 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-9517f519-78cd-4da5-b663-2a30f40233ec tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-volume_attachments/8600d035-2e6e-45b2-9933-77248fad8e1a" status: 200 len: 194 microversion: 2.1 time: 0.044127 Sep 09 13:07:59.375088 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 543/1075] 10.222.0.46 () {58 vars in 1413 bytes} [Fri Sep 9 13:07:59 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-volume_attachments/8600d035-2e6e-45b2-9933-77248fad8e1a => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:08:01.010194 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-00a5fded-c99f-406d-bb81-45f93caee87c tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2e68af0-39a7-4cc4-bb33-c61009cec2ef"}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:08:01.012634 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-00a5fded-c99f-406d-bb81-45f93caee87c tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:08:01.021453 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-00a5fded-c99f-406d-bb81-45f93caee87c tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:01.021936 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-00a5fded-c99f-406d-bb81-45f93caee87c tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:01.022374 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-00a5fded-c99f-406d-bb81-45f93caee87c tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:01.023099 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-00a5fded-c99f-406d-bb81-45f93caee87c tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:01.023565 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-00a5fded-c99f-406d-bb81-45f93caee87c tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:01.023995 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-00a5fded-c99f-406d-bb81-45f93caee87c tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:01.749679 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-00a5fded-c99f-406d-bb81-45f93caee87c tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "POST /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.743280 Sep 09 13:08:01.750397 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 533/1076] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 13:08:01 2022] POST /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-volume_attachments => generated 194 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:08:09.279102 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a34e81a4-bd24-40ec-9c15-9b11e34001b8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:09.281385 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-a34e81a4-bd24-40ec-9c15-9b11e34001b8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:08:09.287679 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a34e81a4-bd24-40ec-9c15-9b11e34001b8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:09.288169 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a34e81a4-bd24-40ec-9c15-9b11e34001b8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:09.288613 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a34e81a4-bd24-40ec-9c15-9b11e34001b8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:09.289334 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a34e81a4-bd24-40ec-9c15-9b11e34001b8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:09.289790 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a34e81a4-bd24-40ec-9c15-9b11e34001b8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:09.290221 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a34e81a4-bd24-40ec-9c15-9b11e34001b8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:09.320505 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-a34e81a4-bd24-40ec-9c15-9b11e34001b8 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045269 Sep 09 13:08:09.321062 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 544/1077] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:08:09 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:08:09.465670 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-28beb18b-964c-484c-b845-dd1e489c754d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:09.466248 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-28beb18b-964c-484c-b845-dd1e489c754d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:08:09.472564 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-28beb18b-964c-484c-b845-dd1e489c754d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:09.473047 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-28beb18b-964c-484c-b845-dd1e489c754d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:09.473481 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-28beb18b-964c-484c-b845-dd1e489c754d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:09.474171 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-28beb18b-964c-484c-b845-dd1e489c754d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:09.474664 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-28beb18b-964c-484c-b845-dd1e489c754d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:09.475094 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-28beb18b-964c-484c-b845-dd1e489c754d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:09.504524 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-28beb18b-964c-484c-b845-dd1e489c754d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-volume_attachments/8600d035-2e6e-45b2-9933-77248fad8e1a" status: 200 len: 194 microversion: 2.1 time: 0.043777 Sep 09 13:08:09.505089 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 534/1078] 10.222.0.46 () {58 vars in 1413 bytes} [Fri Sep 9 13:08:09 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-volume_attachments/8600d035-2e6e-45b2-9933-77248fad8e1a => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:08:09.515932 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-5248175e-1a2e-4523-9da1-6e9de45de95d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:09.516427 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-5248175e-1a2e-4523-9da1-6e9de45de95d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:08:09.522305 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5248175e-1a2e-4523-9da1-6e9de45de95d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:09.522835 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5248175e-1a2e-4523-9da1-6e9de45de95d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:09.523276 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5248175e-1a2e-4523-9da1-6e9de45de95d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:09.523971 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5248175e-1a2e-4523-9da1-6e9de45de95d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:09.524425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5248175e-1a2e-4523-9da1-6e9de45de95d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:09.524864 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5248175e-1a2e-4523-9da1-6e9de45de95d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:09.605563 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.objects.instance [None req-5248175e-1a2e-4523-9da1-6e9de45de95d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lazy-loading 'services' on Instance uuid a9d25e47-5ea7-4711-ae33-cc707f9d18d4 {{(pid=127771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:08:09.805826 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-5248175e-1a2e-4523-9da1-6e9de45de95d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-volume_attachments/8600d035-2e6e-45b2-9933-77248fad8e1a" status: 202 len: 0 microversion: 2.1 time: 0.293986 Sep 09 13:08:09.806464 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 545/1079] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 13:08:09 2022] DELETE /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-volume_attachments/8600d035-2e6e-45b2-9933-77248fad8e1a => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:08:10.927468 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-fd9ae77b-989d-4f8d-8bde-c88f8b076232 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:10.928000 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-fd9ae77b-989d-4f8d-8bde-c88f8b076232 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:08:10.934211 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fd9ae77b-989d-4f8d-8bde-c88f8b076232 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:10.934730 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fd9ae77b-989d-4f8d-8bde-c88f8b076232 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:10.935160 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fd9ae77b-989d-4f8d-8bde-c88f8b076232 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:10.935927 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fd9ae77b-989d-4f8d-8bde-c88f8b076232 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:10.936376 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fd9ae77b-989d-4f8d-8bde-c88f8b076232 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:10.936797 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-fd9ae77b-989d-4f8d-8bde-c88f8b076232 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:10.965946 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-fd9ae77b-989d-4f8d-8bde-c88f8b076232 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-volume_attachments/a2e68af0-39a7-4cc4-bb33-c61009cec2ef" status: 200 len: 194 microversion: 2.1 time: 0.042435 Sep 09 13:08:10.966575 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 535/1080] 10.222.0.46 () {58 vars in 1413 bytes} [Fri Sep 9 13:08:10 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-volume_attachments/a2e68af0-39a7-4cc4-bb33-c61009cec2ef => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:08:10.978968 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0ac74100-b417-4384-984a-a52f32b02743 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:10.979730 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-0ac74100-b417-4384-984a-a52f32b02743 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:08:10.986271 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0ac74100-b417-4384-984a-a52f32b02743 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:10.986801 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0ac74100-b417-4384-984a-a52f32b02743 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:10.989364 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0ac74100-b417-4384-984a-a52f32b02743 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:10.989364 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0ac74100-b417-4384-984a-a52f32b02743 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:10.989364 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0ac74100-b417-4384-984a-a52f32b02743 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:10.989364 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0ac74100-b417-4384-984a-a52f32b02743 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:11.071498 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.objects.instance [None req-0ac74100-b417-4384-984a-a52f32b02743 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lazy-loading 'services' on Instance uuid a9d25e47-5ea7-4711-ae33-cc707f9d18d4 {{(pid=127771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:08:11.273521 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0ac74100-b417-4384-984a-a52f32b02743 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-volume_attachments/a2e68af0-39a7-4cc4-bb33-c61009cec2ef" status: 202 len: 0 microversion: 2.1 time: 0.299311 Sep 09 13:08:11.274112 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 546/1081] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 13:08:10 2022] DELETE /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-volume_attachments/a2e68af0-39a7-4cc4-bb33-c61009cec2ef => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:08:12.449799 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-1d67202d-ecb4-4f45-b23e-6b8b86465459 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:12.452605 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-1d67202d-ecb4-4f45-b23e-6b8b86465459 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:08:12.459103 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1d67202d-ecb4-4f45-b23e-6b8b86465459 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:12.459577 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1d67202d-ecb4-4f45-b23e-6b8b86465459 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:12.460262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1d67202d-ecb4-4f45-b23e-6b8b86465459 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:12.460943 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1d67202d-ecb4-4f45-b23e-6b8b86465459 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:12.461390 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1d67202d-ecb4-4f45-b23e-6b8b86465459 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:12.461807 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1d67202d-ecb4-4f45-b23e-6b8b86465459 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:12.490358 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-1d67202d-ecb4-4f45-b23e-6b8b86465459 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044532 Sep 09 13:08:12.490924 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 536/1082] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:08:12 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 13:08:12.611686 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-5b60de61-0e79-43e7-8e67-3aee84bedee1 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:12.614023 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-5b60de61-0e79-43e7-8e67-3aee84bedee1 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:08:12.620196 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5b60de61-0e79-43e7-8e67-3aee84bedee1 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:12.620684 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5b60de61-0e79-43e7-8e67-3aee84bedee1 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:12.621129 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5b60de61-0e79-43e7-8e67-3aee84bedee1 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:12.621824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5b60de61-0e79-43e7-8e67-3aee84bedee1 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:12.622285 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5b60de61-0e79-43e7-8e67-3aee84bedee1 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:12.622794 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-5b60de61-0e79-43e7-8e67-3aee84bedee1 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:12.652182 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-5b60de61-0e79-43e7-8e67-3aee84bedee1 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045256 Sep 09 13:08:12.652663 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 547/1083] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 13:08:12 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 13:08:12.719625 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-bed81aac-dbaf-458d-a6e9-123da7e8208d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:12.720135 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-bed81aac-dbaf-458d-a6e9-123da7e8208d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:08:12.730262 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bed81aac-dbaf-458d-a6e9-123da7e8208d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:12.730798 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bed81aac-dbaf-458d-a6e9-123da7e8208d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:12.731249 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bed81aac-dbaf-458d-a6e9-123da7e8208d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:12.731964 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bed81aac-dbaf-458d-a6e9-123da7e8208d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:12.732520 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bed81aac-dbaf-458d-a6e9-123da7e8208d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:12.732961 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-bed81aac-dbaf-458d-a6e9-123da7e8208d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:12.758504 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-bed81aac-dbaf-458d-a6e9-123da7e8208d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Going to try to terminate instance {{(pid=127772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:08:13.008583 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-bed81aac-dbaf-458d-a6e9-123da7e8208d tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4" status: 204 len: 0 microversion: 2.1 time: 0.293709 Sep 09 13:08:13.009301 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 537/1084] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:08:12 2022] DELETE /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:08:13.018132 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-0b6ff1e0-8e4a-4886-b8d2-e900cf60dd57 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:13.018768 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-0b6ff1e0-8e4a-4886-b8d2-e900cf60dd57 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:08:13.024824 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0b6ff1e0-8e4a-4886-b8d2-e900cf60dd57 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:13.025320 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0b6ff1e0-8e4a-4886-b8d2-e900cf60dd57 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:13.025768 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0b6ff1e0-8e4a-4886-b8d2-e900cf60dd57 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:13.026468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0b6ff1e0-8e4a-4886-b8d2-e900cf60dd57 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:13.026956 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0b6ff1e0-8e4a-4886-b8d2-e900cf60dd57 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:13.027391 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-0b6ff1e0-8e4a-4886-b8d2-e900cf60dd57 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:13.162519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-0b6ff1e0-8e4a-4886-b8d2-e900cf60dd57 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:08:13.171132 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-0b6ff1e0-8e4a-4886-b8d2-e900cf60dd57 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4" status: 200 len: 1672 microversion: 2.1 time: 0.157422 Sep 09 13:08:13.171705 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 548/1085] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:08:13 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:08:14.195463 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-95996644-91af-442d-a69c-9c6071009fe6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:14.196167 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-95996644-91af-442d-a69c-9c6071009fe6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:08:14.203266 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-95996644-91af-442d-a69c-9c6071009fe6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:14.203753 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-95996644-91af-442d-a69c-9c6071009fe6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:14.204191 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-95996644-91af-442d-a69c-9c6071009fe6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:14.204908 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-95996644-91af-442d-a69c-9c6071009fe6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:14.205363 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-95996644-91af-442d-a69c-9c6071009fe6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:14.205789 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-95996644-91af-442d-a69c-9c6071009fe6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:14.337461 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-95996644-91af-442d-a69c-9c6071009fe6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:08:14.345755 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-95996644-91af-442d-a69c-9c6071009fe6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4" status: 200 len: 1672 microversion: 2.1 time: 0.154646 Sep 09 13:08:14.346314 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 538/1086] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:08:14 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:08:15.369285 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-97e58a46-3344-4f26-ba9c-75a2c13b66eb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:15.369945 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-97e58a46-3344-4f26-ba9c-75a2c13b66eb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:08:15.376773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-97e58a46-3344-4f26-ba9c-75a2c13b66eb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:15.377264 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-97e58a46-3344-4f26-ba9c-75a2c13b66eb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:15.377782 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-97e58a46-3344-4f26-ba9c-75a2c13b66eb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:15.378491 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-97e58a46-3344-4f26-ba9c-75a2c13b66eb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:15.378955 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-97e58a46-3344-4f26-ba9c-75a2c13b66eb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:15.379380 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-97e58a46-3344-4f26-ba9c-75a2c13b66eb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:15.443747 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-97e58a46-3344-4f26-ba9c-75a2c13b66eb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:08:15.453165 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-97e58a46-3344-4f26-ba9c-75a2c13b66eb tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4" status: 200 len: 1604 microversion: 2.1 time: 0.087792 Sep 09 13:08:15.453740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 549/1087] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:08:15 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 => generated 1604 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:08:15.584392 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-f08b4a58-4528-4f34-a226-7b243440f220 req-52611bca-2273-4080-8124-91a1753cfc14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9d25e47-5ea7-4711-ae33-cc707f9d18d4", "name": "network-vif-deleted", "tag": "11585c2c-cd50-4a62-ba20-ca20269885b0"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:08:15.595002 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-f08b4a58-4528-4f34-a226-7b243440f220 req-52611bca-2273-4080-8124-91a1753cfc14 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:15.600358 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-f08b4a58-4528-4f34-a226-7b243440f220 req-52611bca-2273-4080-8124-91a1753cfc14 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:15.600358 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-f08b4a58-4528-4f34-a226-7b243440f220 req-52611bca-2273-4080-8124-91a1753cfc14 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:15.606866 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-f08b4a58-4528-4f34-a226-7b243440f220 req-52611bca-2273-4080-8124-91a1753cfc14 service nova] Creating event network-vif-deleted:11585c2c-cd50-4a62-ba20-ca20269885b0 for instance a9d25e47-5ea7-4711-ae33-cc707f9d18d4 on hv-cinder-81322 Sep 09 13:08:15.612060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-f08b4a58-4528-4f34-a226-7b243440f220 req-52611bca-2273-4080-8124-91a1753cfc14 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031452 Sep 09 13:08:15.612751 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 539/1088] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:08:16.477816 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-18f2ec74-5bb2-46c5-b0e0-602fb72d4ab6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:16.478613 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-18f2ec74-5bb2-46c5-b0e0-602fb72d4ab6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:08:16.485657 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-18f2ec74-5bb2-46c5-b0e0-602fb72d4ab6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:16.486168 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-18f2ec74-5bb2-46c5-b0e0-602fb72d4ab6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:16.486652 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-18f2ec74-5bb2-46c5-b0e0-602fb72d4ab6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:16.492243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-18f2ec74-5bb2-46c5-b0e0-602fb72d4ab6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:16.492243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-18f2ec74-5bb2-46c5-b0e0-602fb72d4ab6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:16.492243 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-18f2ec74-5bb2-46c5-b0e0-602fb72d4ab6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:16.522395 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-18f2ec74-5bb2-46c5-b0e0-602fb72d4ab6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:16.522677 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-18f2ec74-5bb2-46c5-b0e0-602fb72d4ab6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:16.523577 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-18f2ec74-5bb2-46c5-b0e0-602fb72d4ab6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:16.523735 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.objects.instance [None req-18f2ec74-5bb2-46c5-b0e0-602fb72d4ab6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lazy-loading 'fault' on Instance uuid a9d25e47-5ea7-4711-ae33-cc707f9d18d4 {{(pid=127771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:08:16.575436 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-18f2ec74-5bb2-46c5-b0e0-602fb72d4ab6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2cc611fd9341fc9a6d8a5d49f43e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f8b13a6a4844fc9fd20ab2c3ff7368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:08:16.583750 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-18f2ec74-5bb2-46c5-b0e0-602fb72d4ab6 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4" status: 200 len: 1327 microversion: 2.1 time: 0.110044 Sep 09 13:08:16.584323 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 550/1089] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:08:16 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:08:17.610696 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-8ab3bcda-367a-4c07-ab7a-2faa1eca9810 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:17.611395 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-8ab3bcda-367a-4c07-ab7a-2faa1eca9810 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:08:17.617555 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8ab3bcda-367a-4c07-ab7a-2faa1eca9810 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:17.618042 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8ab3bcda-367a-4c07-ab7a-2faa1eca9810 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:17.618496 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8ab3bcda-367a-4c07-ab7a-2faa1eca9810 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:17.619198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8ab3bcda-367a-4c07-ab7a-2faa1eca9810 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:17.619656 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8ab3bcda-367a-4c07-ab7a-2faa1eca9810 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:17.620080 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-8ab3bcda-367a-4c07-ab7a-2faa1eca9810 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:17.634218 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-8ab3bcda-367a-4c07-ab7a-2faa1eca9810 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] HTTP exception thrown: Instance a9d25e47-5ea7-4711-ae33-cc707f9d18d4 could not be found. Sep 09 13:08:17.639169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-8ab3bcda-367a-4c07-ab7a-2faa1eca9810 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Request method failure captured: Sep 09 13:08:17.639169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 HTTP/1.1 Sep 09 13:08:17.639169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 13:08:17.639169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 13:08:17.639169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 13:08:17.639169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 13:08:17.639169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 13:08:17.639169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 13:08:17.639169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 13:08:17.639169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 13:08:17.639169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGzmfgJ3KrOqJOQMzxl-_GnHMWXamRKgJBaf43ejB_EnLaUJL0769nWMJM_wTMM19ejRgnMYhDvvT6TNb9Jc6VkwSHhNLVVqB_uNoRRh-cIcsnuEhPzGPE3_ilUQMkY1cAKfQ8svoK88Sv7CaZSeaoMWudR76dVdDCEfBLrLb-DqmrvI Sep 09 13:08:17.639169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 13:08:17.639169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 13:08:17.639169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 13:08:17.639169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 13:08:17.639169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 13:08:17.639169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 13:08:17.639169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: 31f8b13a6a4844fc9fd20ab2c3ff7368 Sep 09 13:08:17.639169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-AttachVolumeTestJSON-183480646 Sep 09 13:08:17.639169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 13:08:17.639169 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 13:08:17.640955 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31f8b13a6a4844fc9fd20ab2c3ff7368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31f8b13a6a4844fc9fd20ab2c3ff7368", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31f8b13a6a4844fc9fd20ab2c3ff7368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31f8b13a6a4844fc9fd20ab2c3ff7368"}]}] Sep 09 13:08:17.640955 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-AttachVolumeTestJSON-183480646 Sep 09 13:08:17.640955 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: 31f8b13a6a4844fc9fd20ab2c3ff7368 Sep 09 13:08:17.640955 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-AttachVolumeTestJSON-183480646 Sep 09 13:08:17.640955 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-AttachVolumeTestJSON-183480646-project Sep 09 13:08:17.640955 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 13:08:17.640955 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 13:08:17.640955 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: bc2cc611fd9341fc9a6d8a5d49f43e53 Sep 09 13:08:17.640955 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-AttachVolumeTestJSON-183480646-project Sep 09 13:08:17.640955 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: > Sep 09 13:08:17.640955 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Instance a9d25e47-5ea7-4711-ae33-cc707f9d18d4 could not be found. Sep 09 13:08:17.640955 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'id': 'a9d25e47-5ea7-4711-ae33-cc707f9d18d4'} Sep 09 13:08:17.642451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:08:17.642451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:17.642451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:08:17.642451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:08:17.642451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:08:17.642451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:08:17.642451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:08:17.642451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:08:17.642451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:08:17.642451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:08:17.642451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9d25e47-5ea7-4711-ae33-cc707f9d18d4 could not be found. Sep 09 13:08:17.642451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:08:17.642451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:08:17.642451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:08:17.642451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:17.642451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:08:17.642451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:08:17.642451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:08:17.642451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:08:17.642451 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:08:17.644060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:08:17.644060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:08:17.644060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:08:17.644060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:08:17.644060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:08:17.644060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:08:17.644060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:08:17.644060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9d25e47-5ea7-4711-ae33-cc707f9d18d4 could not be found. Sep 09 13:08:17.644060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:08:17.644060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:08:17.644060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:08:17.644060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:17.644060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:08:17.644060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:08:17.644060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:08:17.644060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:08:17.644060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9d25e47-5ea7-4711-ae33-cc707f9d18d4 could not be found. Sep 09 13:08:17.644060 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:08:17.645469 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-8ab3bcda-367a-4c07-ab7a-2faa1eca9810 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Returning 404 to user: Instance a9d25e47-5ea7-4711-ae33-cc707f9d18d4 could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:08:17.645469 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-8ab3bcda-367a-4c07-ab7a-2faa1eca9810 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4" status: 404 len: 111 microversion: 2.1 time: 0.032050 Sep 09 13:08:17.645469 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 540/1090] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:08:17 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 13:08:17.646692 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-558881b4-327c-461b-977a-cf1aeb2d68ee tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '.version_select at 0x7f31832281f0>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:17.718568 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-558881b4-327c-461b-977a-cf1aeb2d68ee tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1192913916" status: 202 len: 0 microversion: 2.1 time: 0.075630 Sep 09 13:08:17.722078 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 551/1091] 10.222.0.46 () {58 vars in 1221 bytes} [Fri Sep 9 13:08:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1192913916 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:08:21.018541 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-dda49a68-cc1b-44b6-97ff-92b6231a217f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:21.019049 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-dda49a68-cc1b-44b6-97ff-92b6231a217f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:08:21.025486 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dda49a68-cc1b-44b6-97ff-92b6231a217f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:21.025970 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dda49a68-cc1b-44b6-97ff-92b6231a217f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:21.026411 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dda49a68-cc1b-44b6-97ff-92b6231a217f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:21.027125 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dda49a68-cc1b-44b6-97ff-92b6231a217f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:21.027579 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dda49a68-cc1b-44b6-97ff-92b6231a217f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:21.028004 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-dda49a68-cc1b-44b6-97ff-92b6231a217f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:21.041154 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-dda49a68-cc1b-44b6-97ff-92b6231a217f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] HTTP exception thrown: Instance a9d25e47-5ea7-4711-ae33-cc707f9d18d4 could not be found. Sep 09 13:08:21.042700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-dda49a68-cc1b-44b6-97ff-92b6231a217f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Request method failure captured: Sep 09 13:08:21.042700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: DELETE /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 HTTP/1.1 Sep 09 13:08:21.042700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 13:08:21.042700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 13:08:21.042700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 13:08:21.042700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 13:08:21.042700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 13:08:21.042700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 13:08:21.042700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 13:08:21.042700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 13:08:21.042700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGzmfgJ3KrOqJOQMzxl-_GnHMWXamRKgJBaf43ejB_EnLaUJL0769nWMJM_wTMM19ejRgnMYhDvvT6TNb9Jc6VkwSHhNLVVqB_uNoRRh-cIcsnuEhPzGPE3_ilUQMkY1cAKfQ8svoK88Sv7CaZSeaoMWudR76dVdDCEfBLrLb-DqmrvI Sep 09 13:08:21.042700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 13:08:21.042700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 13:08:21.042700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 13:08:21.042700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 13:08:21.042700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 13:08:21.042700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 13:08:21.042700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: 31f8b13a6a4844fc9fd20ab2c3ff7368 Sep 09 13:08:21.042700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-AttachVolumeTestJSON-183480646 Sep 09 13:08:21.042700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 13:08:21.042700 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 13:08:21.044280 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31f8b13a6a4844fc9fd20ab2c3ff7368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31f8b13a6a4844fc9fd20ab2c3ff7368", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31f8b13a6a4844fc9fd20ab2c3ff7368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31f8b13a6a4844fc9fd20ab2c3ff7368"}]}] Sep 09 13:08:21.044280 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-AttachVolumeTestJSON-183480646 Sep 09 13:08:21.044280 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: 31f8b13a6a4844fc9fd20ab2c3ff7368 Sep 09 13:08:21.044280 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-AttachVolumeTestJSON-183480646 Sep 09 13:08:21.044280 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-AttachVolumeTestJSON-183480646-project Sep 09 13:08:21.044280 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 13:08:21.044280 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 13:08:21.044280 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: bc2cc611fd9341fc9a6d8a5d49f43e53 Sep 09 13:08:21.044280 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-AttachVolumeTestJSON-183480646-project Sep 09 13:08:21.044280 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: > Sep 09 13:08:21.044280 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Instance a9d25e47-5ea7-4711-ae33-cc707f9d18d4 could not be found. Sep 09 13:08:21.044280 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'id': 'a9d25e47-5ea7-4711-ae33-cc707f9d18d4'} Sep 09 13:08:21.045062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:08:21.045062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:21.045062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:08:21.045062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:08:21.045062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:08:21.045062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:08:21.045062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:08:21.045062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:08:21.045062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:08:21.045062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:08:21.045062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9d25e47-5ea7-4711-ae33-cc707f9d18d4 could not be found. Sep 09 13:08:21.045062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:08:21.045062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:08:21.045062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:08:21.045062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:21.045062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:08:21.045062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:08:21.045062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:08:21.045062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:08:21.045062 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:08:21.047140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:08:21.047140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 13:08:21.047140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 13:08:21.047140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 13:08:21.047140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 13:08:21.047140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:08:21.047140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:08:21.047140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:08:21.047140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:08:21.047140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9d25e47-5ea7-4711-ae33-cc707f9d18d4 could not be found. Sep 09 13:08:21.047140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:08:21.047140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:08:21.047140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:08:21.047140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:21.047140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:08:21.047140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:08:21.047140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:08:21.047140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:08:21.047140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9d25e47-5ea7-4711-ae33-cc707f9d18d4 could not be found. Sep 09 13:08:21.047140 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:08:21.048430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-dda49a68-cc1b-44b6-97ff-92b6231a217f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Returning 404 to user: Instance a9d25e47-5ea7-4711-ae33-cc707f9d18d4 could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:08:21.048430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-dda49a68-cc1b-44b6-97ff-92b6231a217f tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4" status: 404 len: 111 microversion: 2.1 time: 0.030113 Sep 09 13:08:21.048430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 541/1092] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:08:21 2022] DELETE /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:08:21.054497 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8652620c-616a-4c86-af6a-1ff7dc48dd94 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:21.055135 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-8652620c-616a-4c86-af6a-1ff7dc48dd94 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: a9d25e47-5ea7-4711-ae33-cc707f9d18d4] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:08:21.062253 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8652620c-616a-4c86-af6a-1ff7dc48dd94 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:21.062912 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8652620c-616a-4c86-af6a-1ff7dc48dd94 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:21.063352 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8652620c-616a-4c86-af6a-1ff7dc48dd94 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:21.064035 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8652620c-616a-4c86-af6a-1ff7dc48dd94 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:21.064489 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8652620c-616a-4c86-af6a-1ff7dc48dd94 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:21.064913 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8652620c-616a-4c86-af6a-1ff7dc48dd94 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:21.078161 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-8652620c-616a-4c86-af6a-1ff7dc48dd94 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] HTTP exception thrown: Instance a9d25e47-5ea7-4711-ae33-cc707f9d18d4 could not be found. Sep 09 13:08:21.080118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8652620c-616a-4c86-af6a-1ff7dc48dd94 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Request method failure captured: Sep 09 13:08:21.080118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 HTTP/1.1 Sep 09 13:08:21.080118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:08:21.080118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:08:21.080118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:08:21.080118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:08:21.080118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:08:21.080118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:08:21.080118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:08:21.080118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:08:21.080118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzmfgJ3KrOqJOQMzxl-_GnHMWXamRKgJBaf43ejB_EnLaUJL0769nWMJM_wTMM19ejRgnMYhDvvT6TNb9Jc6VkwSHhNLVVqB_uNoRRh-cIcsnuEhPzGPE3_ilUQMkY1cAKfQ8svoK88Sv7CaZSeaoMWudR76dVdDCEfBLrLb-DqmrvI Sep 09 13:08:21.080118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:08:21.080118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:08:21.080118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:08:21.080118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:08:21.080118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:08:21.080118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:08:21.080118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: 31f8b13a6a4844fc9fd20ab2c3ff7368 Sep 09 13:08:21.080118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-AttachVolumeTestJSON-183480646 Sep 09 13:08:21.080118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:08:21.080118 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:08:21.081737 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31f8b13a6a4844fc9fd20ab2c3ff7368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31f8b13a6a4844fc9fd20ab2c3ff7368", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31f8b13a6a4844fc9fd20ab2c3ff7368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31f8b13a6a4844fc9fd20ab2c3ff7368"}]}] Sep 09 13:08:21.081737 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-AttachVolumeTestJSON-183480646 Sep 09 13:08:21.081737 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: 31f8b13a6a4844fc9fd20ab2c3ff7368 Sep 09 13:08:21.081737 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-AttachVolumeTestJSON-183480646 Sep 09 13:08:21.081737 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-AttachVolumeTestJSON-183480646-project Sep 09 13:08:21.081737 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:08:21.081737 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:08:21.081737 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: bc2cc611fd9341fc9a6d8a5d49f43e53 Sep 09 13:08:21.081737 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-AttachVolumeTestJSON-183480646-project Sep 09 13:08:21.081737 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:08:21.081737 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance a9d25e47-5ea7-4711-ae33-cc707f9d18d4 could not be found. Sep 09 13:08:21.081737 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': 'a9d25e47-5ea7-4711-ae33-cc707f9d18d4'} Sep 09 13:08:21.082823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:08:21.082823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:21.082823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:08:21.082823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:08:21.082823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:08:21.082823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:08:21.082823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:08:21.082823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:08:21.082823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:08:21.082823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:08:21.082823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9d25e47-5ea7-4711-ae33-cc707f9d18d4 could not be found. Sep 09 13:08:21.082823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:08:21.082823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:08:21.082823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:08:21.082823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:21.082823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:08:21.082823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:08:21.082823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:08:21.082823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:08:21.082823 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:08:21.084327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:08:21.084327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:08:21.084327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:08:21.084327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:08:21.084327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:08:21.084327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:08:21.084327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:08:21.084327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9d25e47-5ea7-4711-ae33-cc707f9d18d4 could not be found. Sep 09 13:08:21.084327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:08:21.084327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:08:21.084327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:08:21.084327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:21.084327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:08:21.084327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:08:21.084327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:08:21.084327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:08:21.084327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9d25e47-5ea7-4711-ae33-cc707f9d18d4 could not be found. Sep 09 13:08:21.084327 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:08:21.086104 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8652620c-616a-4c86-af6a-1ff7dc48dd94 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Returning 404 to user: Instance a9d25e47-5ea7-4711-ae33-cc707f9d18d4 could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:08:21.086104 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-8652620c-616a-4c86-af6a-1ff7dc48dd94 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4" status: 404 len: 111 microversion: 2.1 time: 0.032314 Sep 09 13:08:21.086104 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 552/1093] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:08:21 2022] GET /compute/v2.1/servers/a9d25e47-5ea7-4711-ae33-cc707f9d18d4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:08:22.341137 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-050c3028-9b82-480b-9f5e-01c231a78649 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:22.341633 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-050c3028-9b82-480b-9f5e-01c231a78649 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:08:22.348157 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-050c3028-9b82-480b-9f5e-01c231a78649 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:22.348629 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-050c3028-9b82-480b-9f5e-01c231a78649 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:22.349061 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-050c3028-9b82-480b-9f5e-01c231a78649 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:22.349742 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-050c3028-9b82-480b-9f5e-01c231a78649 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:22.350191 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-050c3028-9b82-480b-9f5e-01c231a78649 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:22.350642 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-050c3028-9b82-480b-9f5e-01c231a78649 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:22.365656 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.wsgi [None req-050c3028-9b82-480b-9f5e-01c231a78649 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] HTTP exception thrown: Instance f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 could not be found. Sep 09 13:08:22.367198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-050c3028-9b82-480b-9f5e-01c231a78649 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Request method failure captured: Sep 09 13:08:22.367198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: request: DELETE /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 HTTP/1.1 Sep 09 13:08:22.367198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept: application/json Sep 09 13:08:22.367198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Accept-Encoding: identity Sep 09 13:08:22.367198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Connection: close Sep 09 13:08:22.367198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Length: 0 Sep 09 13:08:22.367198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Content-Type: application/json Sep 09 13:08:22.367198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Host: 10.222.0.46 Sep 09 13:08:22.367198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Openstack-System-Scope: None Sep 09 13:08:22.367198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: User-Agent: python-urllib3/1.26.12 Sep 09 13:08:22.367198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Auth-Token: gAAAAABjGzmfgJ3KrOqJOQMzxl-_GnHMWXamRKgJBaf43ejB_EnLaUJL0769nWMJM_wTMM19ejRgnMYhDvvT6TNb9Jc6VkwSHhNLVVqB_uNoRRh-cIcsnuEhPzGPE3_ilUQMkY1cAKfQ8svoK88Sv7CaZSeaoMWudR76dVdDCEfBLrLb-DqmrvI Sep 09 13:08:22.367198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Id: None Sep 09 13:08:22.367198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Domain-Name: None Sep 09 13:08:22.367198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Identity-Status: Confirmed Sep 09 13:08:22.367198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Is-Admin-Project: True Sep 09 13:08:22.367198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Id: default Sep 09 13:08:22.367198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Domain-Name: Default Sep 09 13:08:22.367198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Id: 31f8b13a6a4844fc9fd20ab2c3ff7368 Sep 09 13:08:22.367198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Project-Name: tempest-AttachVolumeTestJSON-183480646 Sep 09 13:08:22.367198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Role: member,reader Sep 09 13:08:22.367198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Roles: member,reader Sep 09 13:08:22.368620 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31f8b13a6a4844fc9fd20ab2c3ff7368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31f8b13a6a4844fc9fd20ab2c3ff7368", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31f8b13a6a4844fc9fd20ab2c3ff7368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31f8b13a6a4844fc9fd20ab2c3ff7368"}]}] Sep 09 13:08:22.368620 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant: tempest-AttachVolumeTestJSON-183480646 Sep 09 13:08:22.368620 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Id: 31f8b13a6a4844fc9fd20ab2c3ff7368 Sep 09 13:08:22.368620 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-Tenant-Name: tempest-AttachVolumeTestJSON-183480646 Sep 09 13:08:22.368620 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User: tempest-AttachVolumeTestJSON-183480646-project Sep 09 13:08:22.368620 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Id: default Sep 09 13:08:22.368620 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Domain-Name: Default Sep 09 13:08:22.368620 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Id: bc2cc611fd9341fc9a6d8a5d49f43e53 Sep 09 13:08:22.368620 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: X-User-Name: tempest-AttachVolumeTestJSON-183480646-project Sep 09 13:08:22.368620 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: method: > Sep 09 13:08:22.368620 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: exception: Instance f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 could not be found. Sep 09 13:08:22.368620 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: action_args: {'id': 'f98258c7-e92a-4ad4-b8c1-9e3c698b48f0'} Sep 09 13:08:22.369473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:08:22.369473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:22.369473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:08:22.369473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:08:22.369473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:08:22.369473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:08:22.369473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:08:22.369473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:08:22.369473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:08:22.369473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:08:22.369473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 could not be found. Sep 09 13:08:22.369473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:08:22.369473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:08:22.369473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:08:22.369473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:22.369473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:08:22.369473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:08:22.369473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:08:22.369473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:08:22.369473 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:08:22.371206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:08:22.371206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 13:08:22.371206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 13:08:22.371206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 13:08:22.371206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 13:08:22.371206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:08:22.371206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:08:22.371206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:08:22.371206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:08:22.371206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 could not be found. Sep 09 13:08:22.371206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:08:22.371206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:08:22.371206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:08:22.371206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:22.371206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:08:22.371206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:08:22.371206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:08:22.371206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:08:22.371206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 could not be found. Sep 09 13:08:22.371206 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: ERROR nova.api.openstack.wsgi Sep 09 13:08:22.372844 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-050c3028-9b82-480b-9f5e-01c231a78649 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Returning 404 to user: Instance f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 could not be found. {{(pid=127772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:08:22.372844 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-050c3028-9b82-480b-9f5e-01c231a78649 tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 404 len: 111 microversion: 2.1 time: 0.031245 Sep 09 13:08:22.372844 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 542/1094] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:08:22 2022] DELETE /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:08:22.377624 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-fa7a4fdc-d82a-48e4-9f84-b16c157e85fa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:22.378178 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-fa7a4fdc-d82a-48e4-9f84-b16c157e85fa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] [instance: f98258c7-e92a-4ad4-b8c1-9e3c698b48f0] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:08:22.380560 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:08:22.385207 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fa7a4fdc-d82a-48e4-9f84-b16c157e85fa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:22.385686 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fa7a4fdc-d82a-48e4-9f84-b16c157e85fa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:22.386119 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fa7a4fdc-d82a-48e4-9f84-b16c157e85fa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:22.386827 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fa7a4fdc-d82a-48e4-9f84-b16c157e85fa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:08:22.387279 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fa7a4fdc-d82a-48e4-9f84-b16c157e85fa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:08:22.387703 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-fa7a4fdc-d82a-48e4-9f84-b16c157e85fa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:08:22.390211 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:08:22.402234 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-fa7a4fdc-d82a-48e4-9f84-b16c157e85fa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] HTTP exception thrown: Instance f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 could not be found. Sep 09 13:08:22.403773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-fa7a4fdc-d82a-48e4-9f84-b16c157e85fa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Request method failure captured: Sep 09 13:08:22.403773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 HTTP/1.1 Sep 09 13:08:22.403773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:08:22.403773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:08:22.403773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:08:22.403773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:08:22.403773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:08:22.403773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:08:22.403773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:08:22.403773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:08:22.403773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzmfgJ3KrOqJOQMzxl-_GnHMWXamRKgJBaf43ejB_EnLaUJL0769nWMJM_wTMM19ejRgnMYhDvvT6TNb9Jc6VkwSHhNLVVqB_uNoRRh-cIcsnuEhPzGPE3_ilUQMkY1cAKfQ8svoK88Sv7CaZSeaoMWudR76dVdDCEfBLrLb-DqmrvI Sep 09 13:08:22.403773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:08:22.403773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:08:22.403773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:08:22.403773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:08:22.403773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:08:22.403773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:08:22.403773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: 31f8b13a6a4844fc9fd20ab2c3ff7368 Sep 09 13:08:22.403773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-AttachVolumeTestJSON-183480646 Sep 09 13:08:22.403773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:08:22.403773 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:08:22.405427 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31f8b13a6a4844fc9fd20ab2c3ff7368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31f8b13a6a4844fc9fd20ab2c3ff7368", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31f8b13a6a4844fc9fd20ab2c3ff7368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31f8b13a6a4844fc9fd20ab2c3ff7368"}]}] Sep 09 13:08:22.405427 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-AttachVolumeTestJSON-183480646 Sep 09 13:08:22.405427 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: 31f8b13a6a4844fc9fd20ab2c3ff7368 Sep 09 13:08:22.405427 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-AttachVolumeTestJSON-183480646 Sep 09 13:08:22.405427 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-AttachVolumeTestJSON-183480646-project Sep 09 13:08:22.405427 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:08:22.405427 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:08:22.405427 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: bc2cc611fd9341fc9a6d8a5d49f43e53 Sep 09 13:08:22.405427 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-AttachVolumeTestJSON-183480646-project Sep 09 13:08:22.405427 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:08:22.405427 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 could not be found. Sep 09 13:08:22.405427 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': 'f98258c7-e92a-4ad4-b8c1-9e3c698b48f0'} Sep 09 13:08:22.406627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:08:22.406627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:22.406627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:08:22.406627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:08:22.406627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:08:22.406627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:08:22.406627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:08:22.406627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:08:22.406627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:08:22.406627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:08:22.406627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 could not be found. Sep 09 13:08:22.406627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:08:22.406627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:08:22.406627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:08:22.406627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:22.406627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:08:22.406627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:08:22.406627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:08:22.406627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:08:22.406627 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:08:22.408210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:08:22.408210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:08:22.408210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:08:22.408210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:08:22.408210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:08:22.408210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:08:22.408210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:08:22.408210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 could not be found. Sep 09 13:08:22.408210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:08:22.408210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:08:22.408210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:08:22.408210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:22.408210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:08:22.408210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:08:22.408210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:08:22.408210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:08:22.408210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 could not be found. Sep 09 13:08:22.408210 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:08:22.409764 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-fa7a4fdc-d82a-48e4-9f84-b16c157e85fa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] Returning 404 to user: Instance f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:08:22.409764 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-fa7a4fdc-d82a-48e4-9f84-b16c157e85fa tempest-AttachVolumeTestJSON-183480646 tempest-AttachVolumeTestJSON-183480646-project] 10.222.0.46 "GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0" status: 404 len: 111 microversion: 2.1 time: 0.032174 Sep 09 13:08:22.409764 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 553/1095] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:08:22 2022] GET /compute/v2.1/servers/f98258c7-e92a-4ad4-b8c1-9e3c698b48f0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:09:51.417366 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:09:51.418113 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:09:51.419570 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 09 13:09:51.419731 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: Fri Sep 9 13:09:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.46) !!! Sep 09 13:09:51.424685 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-56341d8d-111d-44cb-9ea9-c51b37311006 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-602833623", "imageRef": "355bded2-2225-44b2-af86-f9e1861d05ff", "flavorRef": "452", "networks": [{"uuid": "856c0d29-3b9c-4e8d-a343-1e3c8a816a1c"}]}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:09:51.480834 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.network.neutron [None req-56341d8d-111d-44cb-9ea9-c51b37311006 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] validate_networks() for [('856c0d29-3b9c-4e8d-a343-1e3c8a816a1c', None, None, None, None, None)] {{(pid=127772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:09:51.875132 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-56341d8d-111d-44cb-9ea9-c51b37311006 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Flavor limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:09:51.875566 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-56341d8d-111d-44cb-9ea9-c51b37311006 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Image limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:09:51.876037 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-56341d8d-111d-44cb-9ea9-c51b37311006 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Flavor pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:09:51.876445 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-56341d8d-111d-44cb-9ea9-c51b37311006 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Image pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:09:51.876860 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-56341d8d-111d-44cb-9ea9-c51b37311006 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:09:51.885498 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-56341d8d-111d-44cb-9ea9-c51b37311006 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:09:51.885976 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-56341d8d-111d-44cb-9ea9-c51b37311006 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:09:51.886410 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-56341d8d-111d-44cb-9ea9-c51b37311006 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:09:51.887176 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-56341d8d-111d-44cb-9ea9-c51b37311006 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:09:51.888352 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-56341d8d-111d-44cb-9ea9-c51b37311006 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:09:51.888790 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-56341d8d-111d-44cb-9ea9-c51b37311006 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:09:51.905330 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-56341d8d-111d-44cb-9ea9-c51b37311006 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Getting quotas for project 813d39a2302342b18a9316581fa3a14e. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:09:51.909273 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-56341d8d-111d-44cb-9ea9-c51b37311006 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Getting quotas for user 89a1e89f834a495eb4f061eee7fd1676 and project 813d39a2302342b18a9316581fa3a14e. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:09:51.920054 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-56341d8d-111d-44cb-9ea9-c51b37311006 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Going to run 1 instances... {{(pid=127772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:09:51.922318 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-56341d8d-111d-44cb-9ea9-c51b37311006 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 059ed0a1-36d5-485d-8bb7-19aaffbef901] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='355bded2-2225-44b2-af86-f9e1861d05ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:09:52.043104 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-56341d8d-111d-44cb-9ea9-c51b37311006 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627465 Sep 09 13:09:52.043871 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 543/1096] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 13:09:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:09:52.053637 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 13:09:52.054199 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Fri Sep 9 13:09:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901 (ip 10.222.0.46) !!! Sep 09 13:09:52.060585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-185c3469-4ac7-4b2c-ab71-f97bd94a9e0c tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:09:52.061228 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-185c3469-4ac7-4b2c-ab71-f97bd94a9e0c tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 059ed0a1-36d5-485d-8bb7-19aaffbef901] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:09:52.122288 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-185c3469-4ac7-4b2c-ab71-f97bd94a9e0c tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:09:52.130526 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-185c3469-4ac7-4b2c-ab71-f97bd94a9e0c tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901" status: 200 len: 1213 microversion: 2.1 time: 0.079304 Sep 09 13:09:52.131189 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 554/1097] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:09:52 2022] GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:09:53.154703 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-508f0445-33fb-4cce-ab94-086fa067fec5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:09:53.155325 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-508f0445-33fb-4cce-ab94-086fa067fec5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 059ed0a1-36d5-485d-8bb7-19aaffbef901] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:09:53.207954 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-508f0445-33fb-4cce-ab94-086fa067fec5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:09:53.216184 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-508f0445-33fb-4cce-ab94-086fa067fec5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901" status: 200 len: 1213 microversion: 2.1 time: 0.066234 Sep 09 13:09:53.216735 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 544/1098] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:09:53 2022] GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:09:54.239886 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-1ecc45ab-55de-4853-854c-4950ecbac30f tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:09:54.240515 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-1ecc45ab-55de-4853-854c-4950ecbac30f tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 059ed0a1-36d5-485d-8bb7-19aaffbef901] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:09:54.247726 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1ecc45ab-55de-4853-854c-4950ecbac30f tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:09:54.248159 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1ecc45ab-55de-4853-854c-4950ecbac30f tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:09:54.248603 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1ecc45ab-55de-4853-854c-4950ecbac30f tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:09:54.249297 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1ecc45ab-55de-4853-854c-4950ecbac30f tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:09:54.249756 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1ecc45ab-55de-4853-854c-4950ecbac30f tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:09:54.250194 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-1ecc45ab-55de-4853-854c-4950ecbac30f tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:09:54.312585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-1ecc45ab-55de-4853-854c-4950ecbac30f tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:09:54.320214 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-1ecc45ab-55de-4853-854c-4950ecbac30f tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901" status: 200 len: 1265 microversion: 2.1 time: 0.084629 Sep 09 13:09:54.320789 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 555/1099] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:09:54 2022] GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:09:55.345208 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-39256cb6-376d-4656-bfff-d2da1909bd83 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:09:55.345819 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-39256cb6-376d-4656-bfff-d2da1909bd83 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 059ed0a1-36d5-485d-8bb7-19aaffbef901] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:09:55.352211 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-39256cb6-376d-4656-bfff-d2da1909bd83 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:09:55.352679 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-39256cb6-376d-4656-bfff-d2da1909bd83 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:09:55.353105 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-39256cb6-376d-4656-bfff-d2da1909bd83 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:09:55.353787 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-39256cb6-376d-4656-bfff-d2da1909bd83 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:09:55.354236 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-39256cb6-376d-4656-bfff-d2da1909bd83 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:09:55.354698 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-39256cb6-376d-4656-bfff-d2da1909bd83 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:09:55.575381 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-39256cb6-376d-4656-bfff-d2da1909bd83 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:09:55.585507 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-39256cb6-376d-4656-bfff-d2da1909bd83 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901" status: 200 len: 1313 microversion: 2.1 time: 0.244125 Sep 09 13:09:55.586343 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 545/1100] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:09:55 2022] GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:09:56.215757 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-9f121f66-9197-4955-98a7-fa38a391eb26 req-e8bfb86f-30c2-4929-a30d-a778127bd395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "059ed0a1-36d5-485d-8bb7-19aaffbef901", "tag": "2fd59196-b4eb-4a80-a1c3-51880c28e923"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:09:56.225614 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-9f121f66-9197-4955-98a7-fa38a391eb26 req-e8bfb86f-30c2-4929-a30d-a778127bd395 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:09:56.226097 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-9f121f66-9197-4955-98a7-fa38a391eb26 req-e8bfb86f-30c2-4929-a30d-a778127bd395 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:09:56.226558 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-9f121f66-9197-4955-98a7-fa38a391eb26 req-e8bfb86f-30c2-4929-a30d-a778127bd395 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:09:56.237767 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-9f121f66-9197-4955-98a7-fa38a391eb26 req-e8bfb86f-30c2-4929-a30d-a778127bd395 service nova] Creating event network-changed:2fd59196-b4eb-4a80-a1c3-51880c28e923 for instance 059ed0a1-36d5-485d-8bb7-19aaffbef901 on hv-cinder-81322 Sep 09 13:09:56.242640 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-9f121f66-9197-4955-98a7-fa38a391eb26 req-e8bfb86f-30c2-4929-a30d-a778127bd395 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030687 Sep 09 13:09:56.243237 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 556/1101] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:09:56.609471 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-2f3939c7-e74d-4b55-a1a2-b233e4988404 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:09:56.610203 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-2f3939c7-e74d-4b55-a1a2-b233e4988404 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 059ed0a1-36d5-485d-8bb7-19aaffbef901] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:09:56.616349 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2f3939c7-e74d-4b55-a1a2-b233e4988404 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:09:56.616828 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2f3939c7-e74d-4b55-a1a2-b233e4988404 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:09:56.617268 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2f3939c7-e74d-4b55-a1a2-b233e4988404 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:09:56.617956 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2f3939c7-e74d-4b55-a1a2-b233e4988404 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:09:56.618407 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2f3939c7-e74d-4b55-a1a2-b233e4988404 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:09:56.618855 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2f3939c7-e74d-4b55-a1a2-b233e4988404 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:09:56.807769 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-2f3939c7-e74d-4b55-a1a2-b233e4988404 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:09:56.815929 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-2f3939c7-e74d-4b55-a1a2-b233e4988404 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901" status: 200 len: 1313 microversion: 2.1 time: 0.210576 Sep 09 13:09:56.816494 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 546/1102] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:09:56 2022] GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:09:57.841279 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-43fa731b-6fbf-474f-80a6-4778c0703bf9 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:09:57.841974 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-43fa731b-6fbf-474f-80a6-4778c0703bf9 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 059ed0a1-36d5-485d-8bb7-19aaffbef901] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:09:57.848253 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-43fa731b-6fbf-474f-80a6-4778c0703bf9 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:09:57.848738 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-43fa731b-6fbf-474f-80a6-4778c0703bf9 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:09:57.849174 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-43fa731b-6fbf-474f-80a6-4778c0703bf9 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:09:57.849862 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-43fa731b-6fbf-474f-80a6-4778c0703bf9 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:09:57.850319 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-43fa731b-6fbf-474f-80a6-4778c0703bf9 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:09:57.850774 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-43fa731b-6fbf-474f-80a6-4778c0703bf9 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:09:57.983459 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-43fa731b-6fbf-474f-80a6-4778c0703bf9 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:09:57.991513 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-43fa731b-6fbf-474f-80a6-4778c0703bf9 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901" status: 200 len: 1313 microversion: 2.1 time: 0.155979 Sep 09 13:09:57.992093 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 557/1103] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:09:57 2022] GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:09:59.015633 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-9b928c4e-9e7b-4114-8c29-9b8f17c2bb96 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:09:59.016248 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-9b928c4e-9e7b-4114-8c29-9b8f17c2bb96 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 059ed0a1-36d5-485d-8bb7-19aaffbef901] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:09:59.022665 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9b928c4e-9e7b-4114-8c29-9b8f17c2bb96 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:09:59.027663 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9b928c4e-9e7b-4114-8c29-9b8f17c2bb96 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:09:59.027663 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9b928c4e-9e7b-4114-8c29-9b8f17c2bb96 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:09:59.027663 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9b928c4e-9e7b-4114-8c29-9b8f17c2bb96 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:09:59.027663 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9b928c4e-9e7b-4114-8c29-9b8f17c2bb96 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:09:59.028679 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9b928c4e-9e7b-4114-8c29-9b8f17c2bb96 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:09:59.154130 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-9b928c4e-9e7b-4114-8c29-9b8f17c2bb96 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:09:59.161701 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-9b928c4e-9e7b-4114-8c29-9b8f17c2bb96 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901" status: 200 len: 1313 microversion: 2.1 time: 0.150546 Sep 09 13:09:59.162255 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 547/1104] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:09:59 2022] GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:00.187134 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-ffd19f03-f8f7-4ba6-9e72-46dd3d8fdbb1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:00.187767 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-ffd19f03-f8f7-4ba6-9e72-46dd3d8fdbb1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 059ed0a1-36d5-485d-8bb7-19aaffbef901] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:00.194247 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ffd19f03-f8f7-4ba6-9e72-46dd3d8fdbb1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:00.194767 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ffd19f03-f8f7-4ba6-9e72-46dd3d8fdbb1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:00.195202 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ffd19f03-f8f7-4ba6-9e72-46dd3d8fdbb1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:00.195928 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ffd19f03-f8f7-4ba6-9e72-46dd3d8fdbb1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:00.196405 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ffd19f03-f8f7-4ba6-9e72-46dd3d8fdbb1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:00.196862 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-ffd19f03-f8f7-4ba6-9e72-46dd3d8fdbb1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:00.327046 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-ffd19f03-f8f7-4ba6-9e72-46dd3d8fdbb1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:10:00.334587 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-ffd19f03-f8f7-4ba6-9e72-46dd3d8fdbb1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901" status: 200 len: 1313 microversion: 2.1 time: 0.152275 Sep 09 13:10:00.335147 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 558/1105] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:00 2022] GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:01.358471 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-13c0aa42-0c7e-472b-bffa-cf60190ca336 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:01.359110 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-13c0aa42-0c7e-472b-bffa-cf60190ca336 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 059ed0a1-36d5-485d-8bb7-19aaffbef901] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:01.365538 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-13c0aa42-0c7e-472b-bffa-cf60190ca336 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:01.366025 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-13c0aa42-0c7e-472b-bffa-cf60190ca336 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:01.366464 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-13c0aa42-0c7e-472b-bffa-cf60190ca336 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:01.367187 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-13c0aa42-0c7e-472b-bffa-cf60190ca336 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:01.367646 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-13c0aa42-0c7e-472b-bffa-cf60190ca336 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:01.368077 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-13c0aa42-0c7e-472b-bffa-cf60190ca336 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:01.515162 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-13c0aa42-0c7e-472b-bffa-cf60190ca336 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:10:01.524332 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-13c0aa42-0c7e-472b-bffa-cf60190ca336 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901" status: 200 len: 1313 microversion: 2.1 time: 0.169824 Sep 09 13:10:01.524885 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 548/1106] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:01 2022] GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:01.900969 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-8ebb6ceb-47cf-49f5-af50-152bc757733a req-7f585373-f591-4379-bd95-fcb8b657c8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "059ed0a1-36d5-485d-8bb7-19aaffbef901", "name": "network-vif-plugged", "status": "completed", "tag": "2fd59196-b4eb-4a80-a1c3-51880c28e923"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:10:01.911047 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-8ebb6ceb-47cf-49f5-af50-152bc757733a req-7f585373-f591-4379-bd95-fcb8b657c8f5 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:01.911528 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-8ebb6ceb-47cf-49f5-af50-152bc757733a req-7f585373-f591-4379-bd95-fcb8b657c8f5 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:01.911965 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-8ebb6ceb-47cf-49f5-af50-152bc757733a req-7f585373-f591-4379-bd95-fcb8b657c8f5 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:01.923265 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-8ebb6ceb-47cf-49f5-af50-152bc757733a req-7f585373-f591-4379-bd95-fcb8b657c8f5 service nova] Creating event network-vif-plugged:2fd59196-b4eb-4a80-a1c3-51880c28e923 for instance 059ed0a1-36d5-485d-8bb7-19aaffbef901 on hv-cinder-81322 Sep 09 13:10:01.928190 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-8ebb6ceb-47cf-49f5-af50-152bc757733a req-7f585373-f591-4379-bd95-fcb8b657c8f5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151138 Sep 09 13:10:01.928832 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 559/1107] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:10:02.547545 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-7d431861-12b9-4208-9c64-c9c584dc0eb4 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:02.548158 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-7d431861-12b9-4208-9c64-c9c584dc0eb4 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 059ed0a1-36d5-485d-8bb7-19aaffbef901] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:02.549986 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=2 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:02.555212 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7d431861-12b9-4208-9c64-c9c584dc0eb4 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:02.555689 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7d431861-12b9-4208-9c64-c9c584dc0eb4 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:02.556120 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7d431861-12b9-4208-9c64-c9c584dc0eb4 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:02.556799 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7d431861-12b9-4208-9c64-c9c584dc0eb4 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:02.557247 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7d431861-12b9-4208-9c64-c9c584dc0eb4 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:02.557665 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-7d431861-12b9-4208-9c64-c9c584dc0eb4 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:02.686198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-7d431861-12b9-4208-9c64-c9c584dc0eb4 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:10:02.693867 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-7d431861-12b9-4208-9c64-c9c584dc0eb4 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901" status: 200 len: 1313 microversion: 2.1 time: 0.150352 Sep 09 13:10:02.694429 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 549/1108] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:02 2022] GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:03.714780 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=2 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:03.719681 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-d72dd021-6dbb-4b4f-ae0a-b88bae356aac tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:03.721526 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-d72dd021-6dbb-4b4f-ae0a-b88bae356aac tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 059ed0a1-36d5-485d-8bb7-19aaffbef901] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:03.726440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d72dd021-6dbb-4b4f-ae0a-b88bae356aac tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:03.726964 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d72dd021-6dbb-4b4f-ae0a-b88bae356aac tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:03.727405 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d72dd021-6dbb-4b4f-ae0a-b88bae356aac tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:03.728125 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d72dd021-6dbb-4b4f-ae0a-b88bae356aac tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:03.728575 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d72dd021-6dbb-4b4f-ae0a-b88bae356aac tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:03.729005 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-d72dd021-6dbb-4b4f-ae0a-b88bae356aac tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:03.867112 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-d72dd021-6dbb-4b4f-ae0a-b88bae356aac tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:10:03.875374 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-d72dd021-6dbb-4b4f-ae0a-b88bae356aac tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901" status: 200 len: 1497 microversion: 2.1 time: 0.161555 Sep 09 13:10:03.875950 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 560/1109] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:03 2022] GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901 => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:04.701097 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-1f6832ee-5774-4349-808b-5cae4962d7b9 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:04.701625 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-1f6832ee-5774-4349-808b-5cae4962d7b9 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 059ed0a1-36d5-485d-8bb7-19aaffbef901] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:04.703430 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=8 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:04.708715 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1f6832ee-5774-4349-808b-5cae4962d7b9 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:04.709195 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1f6832ee-5774-4349-808b-5cae4962d7b9 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:04.709633 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1f6832ee-5774-4349-808b-5cae4962d7b9 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:04.710320 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1f6832ee-5774-4349-808b-5cae4962d7b9 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:04.711150 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1f6832ee-5774-4349-808b-5cae4962d7b9 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:04.711574 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-1f6832ee-5774-4349-808b-5cae4962d7b9 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:04.740447 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-1f6832ee-5774-4349-808b-5cae4962d7b9 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 059ed0a1-36d5-485d-8bb7-19aaffbef901] Going to try to terminate instance {{(pid=127772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:10:04.977186 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-1f6832ee-5774-4349-808b-5cae4962d7b9 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "DELETE /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901" status: 204 len: 0 microversion: 2.1 time: 0.280807 Sep 09 13:10:04.977784 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 550/1110] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:10:04 2022] DELETE /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:04.987103 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-2bd2dd90-2877-4fdd-9978-2d844b84fd84 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:04.987734 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-2bd2dd90-2877-4fdd-9978-2d844b84fd84 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 059ed0a1-36d5-485d-8bb7-19aaffbef901] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:04.994577 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2bd2dd90-2877-4fdd-9978-2d844b84fd84 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:04.995015 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2bd2dd90-2877-4fdd-9978-2d844b84fd84 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:04.995461 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2bd2dd90-2877-4fdd-9978-2d844b84fd84 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:04.996207 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2bd2dd90-2877-4fdd-9978-2d844b84fd84 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:04.996669 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2bd2dd90-2877-4fdd-9978-2d844b84fd84 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:04.997786 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-2bd2dd90-2877-4fdd-9978-2d844b84fd84 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:05.127114 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-2bd2dd90-2877-4fdd-9978-2d844b84fd84 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:10:05.134796 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-2bd2dd90-2877-4fdd-9978-2d844b84fd84 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901" status: 200 len: 1503 microversion: 2.1 time: 0.151931 Sep 09 13:10:05.135358 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 561/1111] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:04 2022] GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:06.159391 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-083f9932-6738-445a-addf-e0e0841084f5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:06.160203 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-083f9932-6738-445a-addf-e0e0841084f5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 059ed0a1-36d5-485d-8bb7-19aaffbef901] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:06.167711 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-083f9932-6738-445a-addf-e0e0841084f5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:06.168193 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-083f9932-6738-445a-addf-e0e0841084f5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:06.168620 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-083f9932-6738-445a-addf-e0e0841084f5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:06.170030 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-083f9932-6738-445a-addf-e0e0841084f5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:06.170474 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-083f9932-6738-445a-addf-e0e0841084f5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:06.170922 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-083f9932-6738-445a-addf-e0e0841084f5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:06.338764 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-083f9932-6738-445a-addf-e0e0841084f5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:10:06.347332 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-083f9932-6738-445a-addf-e0e0841084f5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901" status: 200 len: 1503 microversion: 2.1 time: 0.192398 Sep 09 13:10:06.347911 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 551/1112] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:06 2022] GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901 => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:07.033948 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-fbca707f-6ebe-4a86-aa53-e3b1c0242971 req-ec4b12c4-ebda-4f7a-92a8-864e2c636686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "059ed0a1-36d5-485d-8bb7-19aaffbef901", "name": "network-vif-deleted", "tag": "2fd59196-b4eb-4a80-a1c3-51880c28e923"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:10:07.043645 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-fbca707f-6ebe-4a86-aa53-e3b1c0242971 req-ec4b12c4-ebda-4f7a-92a8-864e2c636686 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:07.050040 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-fbca707f-6ebe-4a86-aa53-e3b1c0242971 req-ec4b12c4-ebda-4f7a-92a8-864e2c636686 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:07.050040 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-fbca707f-6ebe-4a86-aa53-e3b1c0242971 req-ec4b12c4-ebda-4f7a-92a8-864e2c636686 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:07.055402 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-fbca707f-6ebe-4a86-aa53-e3b1c0242971 req-ec4b12c4-ebda-4f7a-92a8-864e2c636686 service nova] Creating event network-vif-deleted:2fd59196-b4eb-4a80-a1c3-51880c28e923 for instance 059ed0a1-36d5-485d-8bb7-19aaffbef901 on hv-cinder-81322 Sep 09 13:10:07.060838 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-fbca707f-6ebe-4a86-aa53-e3b1c0242971 req-ec4b12c4-ebda-4f7a-92a8-864e2c636686 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030536 Sep 09 13:10:07.061435 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 562/1113] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:10:07.371011 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-88f920dd-0c8f-4cfb-b19e-8986b811d0ea tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:07.371549 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-88f920dd-0c8f-4cfb-b19e-8986b811d0ea tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 059ed0a1-36d5-485d-8bb7-19aaffbef901] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:07.379276 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88f920dd-0c8f-4cfb-b19e-8986b811d0ea tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:07.379763 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88f920dd-0c8f-4cfb-b19e-8986b811d0ea tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:07.380192 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88f920dd-0c8f-4cfb-b19e-8986b811d0ea tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:07.380888 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88f920dd-0c8f-4cfb-b19e-8986b811d0ea tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:07.381339 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88f920dd-0c8f-4cfb-b19e-8986b811d0ea tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:07.381760 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88f920dd-0c8f-4cfb-b19e-8986b811d0ea tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:07.412283 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88f920dd-0c8f-4cfb-b19e-8986b811d0ea tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:07.412750 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88f920dd-0c8f-4cfb-b19e-8986b811d0ea tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:07.413177 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-88f920dd-0c8f-4cfb-b19e-8986b811d0ea tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:07.413621 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.objects.instance [None req-88f920dd-0c8f-4cfb-b19e-8986b811d0ea tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lazy-loading 'fault' on Instance uuid 059ed0a1-36d5-485d-8bb7-19aaffbef901 {{(pid=127772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:10:07.458962 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-88f920dd-0c8f-4cfb-b19e-8986b811d0ea tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:10:07.468173 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-88f920dd-0c8f-4cfb-b19e-8986b811d0ea tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901" status: 200 len: 1303 microversion: 2.1 time: 0.101067 Sep 09 13:10:07.468773 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 552/1114] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:07 2022] GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901 => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:08.492704 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-4af87d6a-8df7-49d7-b105-64e4f9723fb1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:08.493418 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-4af87d6a-8df7-49d7-b105-64e4f9723fb1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 059ed0a1-36d5-485d-8bb7-19aaffbef901] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:08.500080 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4af87d6a-8df7-49d7-b105-64e4f9723fb1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:08.500572 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4af87d6a-8df7-49d7-b105-64e4f9723fb1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:08.501016 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4af87d6a-8df7-49d7-b105-64e4f9723fb1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:08.501740 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4af87d6a-8df7-49d7-b105-64e4f9723fb1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:08.502204 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4af87d6a-8df7-49d7-b105-64e4f9723fb1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:08.502660 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-4af87d6a-8df7-49d7-b105-64e4f9723fb1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:08.518282 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-4af87d6a-8df7-49d7-b105-64e4f9723fb1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] HTTP exception thrown: Instance 059ed0a1-36d5-485d-8bb7-19aaffbef901 could not be found. Sep 09 13:10:08.519922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-4af87d6a-8df7-49d7-b105-64e4f9723fb1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Request method failure captured: Sep 09 13:10:08.519922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901 HTTP/1.1 Sep 09 13:10:08.519922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:10:08.519922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:10:08.519922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:10:08.519922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:10:08.519922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:10:08.519922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:10:08.519922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:10:08.519922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:10:08.519922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzsdIgM-vm4MeHKRcEWdshzVjCUp57a0XeRhliDZe3uwoqWLJ0JJPfzTsJcMZosDYCqdCAr1q6Pebd4EN1s1olMo-NH1EWOkqz2JaWMRZfxPYX7LRGB7AKWLEvWBw5Rhgxge-AhvrHq96QeRarv-bcDk7K98VbghXqj_Sa3GYFEYhDY Sep 09 13:10:08.519922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:10:08.519922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:10:08.519922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:10:08.519922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:10:08.519922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:10:08.519922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:10:08.519922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: 813d39a2302342b18a9316581fa3a14e Sep 09 13:10:08.519922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-VolumesActionsTest-756758309 Sep 09 13:10:08.519922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:10:08.519922 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:10:08.521723 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/813d39a2302342b18a9316581fa3a14e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_813d39a2302342b18a9316581fa3a14e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/813d39a2302342b18a9316581fa3a14e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/813d39a2302342b18a9316581fa3a14e"}]}] Sep 09 13:10:08.521723 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-VolumesActionsTest-756758309 Sep 09 13:10:08.521723 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: 813d39a2302342b18a9316581fa3a14e Sep 09 13:10:08.521723 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-VolumesActionsTest-756758309 Sep 09 13:10:08.521723 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-VolumesActionsTest-756758309-project Sep 09 13:10:08.521723 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:10:08.521723 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:10:08.521723 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 89a1e89f834a495eb4f061eee7fd1676 Sep 09 13:10:08.521723 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-VolumesActionsTest-756758309-project Sep 09 13:10:08.521723 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:10:08.521723 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance 059ed0a1-36d5-485d-8bb7-19aaffbef901 could not be found. Sep 09 13:10:08.521723 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': '059ed0a1-36d5-485d-8bb7-19aaffbef901'} Sep 09 13:10:08.522866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:10:08.522866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:10:08.522866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:10:08.522866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:10:08.522866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:10:08.522866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:10:08.522866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:10:08.522866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:10:08.522866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:10:08.522866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:10:08.522866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 059ed0a1-36d5-485d-8bb7-19aaffbef901 could not be found. Sep 09 13:10:08.522866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:10:08.522866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:10:08.522866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:10:08.522866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:10:08.522866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:10:08.522866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:10:08.522866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:10:08.522866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:10:08.522866 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:10:08.524529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:10:08.524529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:10:08.524529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:10:08.524529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:10:08.524529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:10:08.524529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:10:08.524529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:10:08.524529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 059ed0a1-36d5-485d-8bb7-19aaffbef901 could not be found. Sep 09 13:10:08.524529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:10:08.524529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:10:08.524529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:10:08.524529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:10:08.524529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:10:08.524529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:10:08.524529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:10:08.524529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:10:08.524529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 059ed0a1-36d5-485d-8bb7-19aaffbef901 could not be found. Sep 09 13:10:08.524529 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:10:08.525991 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-4af87d6a-8df7-49d7-b105-64e4f9723fb1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Returning 404 to user: Instance 059ed0a1-36d5-485d-8bb7-19aaffbef901 could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:10:08.525991 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-4af87d6a-8df7-49d7-b105-64e4f9723fb1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901" status: 404 len: 111 microversion: 2.1 time: 0.033407 Sep 09 13:10:08.525991 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 563/1115] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:08 2022] GET /compute/v2.1/servers/059ed0a1-36d5-485d-8bb7-19aaffbef901 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:10:08.571464 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-533ebb8d-a361-409d-bcfe-32635741d8f8 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1280664554", "imageRef": "355bded2-2225-44b2-af86-f9e1861d05ff", "flavorRef": "452", "networks": [{"uuid": "856c0d29-3b9c-4e8d-a343-1e3c8a816a1c"}]}} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:10:08.624198 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.network.neutron [None req-533ebb8d-a361-409d-bcfe-32635741d8f8 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] validate_networks() for [('856c0d29-3b9c-4e8d-a343-1e3c8a816a1c', None, None, None, None, None)] {{(pid=127772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:10:08.963862 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-533ebb8d-a361-409d-bcfe-32635741d8f8 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Flavor limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:10:08.964287 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-533ebb8d-a361-409d-bcfe-32635741d8f8 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Image limits 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:10:08.964799 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-533ebb8d-a361-409d-bcfe-32635741d8f8 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Flavor pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:10:08.965241 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-533ebb8d-a361-409d-bcfe-32635741d8f8 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Image pref 0:0:0 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:10:08.966301 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.virt.hardware [None req-533ebb8d-a361-409d-bcfe-32635741d8f8 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:10:08.975074 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-533ebb8d-a361-409d-bcfe-32635741d8f8 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:08.975555 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-533ebb8d-a361-409d-bcfe-32635741d8f8 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:08.975983 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-533ebb8d-a361-409d-bcfe-32635741d8f8 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:08.976703 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-533ebb8d-a361-409d-bcfe-32635741d8f8 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:08.977152 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-533ebb8d-a361-409d-bcfe-32635741d8f8 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:08.977570 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-533ebb8d-a361-409d-bcfe-32635741d8f8 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:08.993907 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-533ebb8d-a361-409d-bcfe-32635741d8f8 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Getting quotas for project 813d39a2302342b18a9316581fa3a14e. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:10:08.997915 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.quota [None req-533ebb8d-a361-409d-bcfe-32635741d8f8 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Getting quotas for user 89a1e89f834a495eb4f061eee7fd1676 and project 813d39a2302342b18a9316581fa3a14e. Resources: {'instances', 'cores', 'ram'} {{(pid=127772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:10:09.009600 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-533ebb8d-a361-409d-bcfe-32635741d8f8 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Going to run 1 instances... {{(pid=127772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:10:09.011953 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-533ebb8d-a361-409d-bcfe-32635741d8f8 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 875dc635-0c80-400a-9a7f-92998b74fcd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='355bded2-2225-44b2-af86-f9e1861d05ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:10:09.145705 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-533ebb8d-a361-409d-bcfe-32635741d8f8 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577973 Sep 09 13:10:09.150614 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 553/1116] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 13:10:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:10:09.158388 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-f027c149-7132-4da8-858e-0461ecaa6d92 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:09.159031 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-f027c149-7132-4da8-858e-0461ecaa6d92 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 875dc635-0c80-400a-9a7f-92998b74fcd6] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:09.213509 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-f027c149-7132-4da8-858e-0461ecaa6d92 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:10:09.221035 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-f027c149-7132-4da8-858e-0461ecaa6d92 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6" status: 200 len: 1214 microversion: 2.1 time: 0.066742 Sep 09 13:10:09.221601 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 564/1117] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:09 2022] GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:10.244446 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-2b5dd5bc-508e-4279-9831-f6dac0a02285 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:10.245217 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-2b5dd5bc-508e-4279-9831-f6dac0a02285 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 875dc635-0c80-400a-9a7f-92998b74fcd6] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:10.253162 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2b5dd5bc-508e-4279-9831-f6dac0a02285 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:10.253652 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2b5dd5bc-508e-4279-9831-f6dac0a02285 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:10.254090 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2b5dd5bc-508e-4279-9831-f6dac0a02285 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:10.254821 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2b5dd5bc-508e-4279-9831-f6dac0a02285 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:10.255345 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2b5dd5bc-508e-4279-9831-f6dac0a02285 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:10.255771 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-2b5dd5bc-508e-4279-9831-f6dac0a02285 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:10.317706 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-2b5dd5bc-508e-4279-9831-f6dac0a02285 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:10:10.325476 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-2b5dd5bc-508e-4279-9831-f6dac0a02285 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6" status: 200 len: 1210 microversion: 2.1 time: 0.085324 Sep 09 13:10:10.329123 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 554/1118] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:10 2022] GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:11.350873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-325feb82-b1b4-4206-97a9-09f0a708c7f1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:11.350873 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-325feb82-b1b4-4206-97a9-09f0a708c7f1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 875dc635-0c80-400a-9a7f-92998b74fcd6] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:11.357490 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-325feb82-b1b4-4206-97a9-09f0a708c7f1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:11.358041 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-325feb82-b1b4-4206-97a9-09f0a708c7f1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:11.358541 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-325feb82-b1b4-4206-97a9-09f0a708c7f1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:11.359218 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-325feb82-b1b4-4206-97a9-09f0a708c7f1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:11.359686 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-325feb82-b1b4-4206-97a9-09f0a708c7f1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:11.360121 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-325feb82-b1b4-4206-97a9-09f0a708c7f1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:11.427168 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-325feb82-b1b4-4206-97a9-09f0a708c7f1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:10:11.434926 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-325feb82-b1b4-4206-97a9-09f0a708c7f1 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6" status: 200 len: 1272 microversion: 2.1 time: 0.089823 Sep 09 13:10:11.435494 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 565/1119] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:11 2022] GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6 => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:12.461606 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-ff8ead8a-a926-460e-817f-c30730a50e52 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:12.462216 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-ff8ead8a-a926-460e-817f-c30730a50e52 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 875dc635-0c80-400a-9a7f-92998b74fcd6] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:12.468845 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ff8ead8a-a926-460e-817f-c30730a50e52 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:12.469351 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ff8ead8a-a926-460e-817f-c30730a50e52 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:12.469780 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ff8ead8a-a926-460e-817f-c30730a50e52 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:12.470474 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ff8ead8a-a926-460e-817f-c30730a50e52 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:12.470948 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ff8ead8a-a926-460e-817f-c30730a50e52 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:12.471375 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-ff8ead8a-a926-460e-817f-c30730a50e52 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:12.623470 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-ff8ead8a-a926-460e-817f-c30730a50e52 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:10:12.631927 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-ff8ead8a-a926-460e-817f-c30730a50e52 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6" status: 200 len: 1314 microversion: 2.1 time: 0.174546 Sep 09 13:10:12.632467 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 555/1120] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:12 2022] GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:12.654255 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-40773562-2b4e-41a7-9c8d-531f678ec3dc req-ff8f6831-31e2-413f-8c1e-cc9bd332f7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "875dc635-0c80-400a-9a7f-92998b74fcd6", "tag": "b140609b-8045-491e-ae95-a4805fec9a84"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:10:12.666575 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-40773562-2b4e-41a7-9c8d-531f678ec3dc req-ff8f6831-31e2-413f-8c1e-cc9bd332f7b3 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:12.666575 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-40773562-2b4e-41a7-9c8d-531f678ec3dc req-ff8f6831-31e2-413f-8c1e-cc9bd332f7b3 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:12.666575 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-40773562-2b4e-41a7-9c8d-531f678ec3dc req-ff8f6831-31e2-413f-8c1e-cc9bd332f7b3 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:12.677880 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-40773562-2b4e-41a7-9c8d-531f678ec3dc req-ff8f6831-31e2-413f-8c1e-cc9bd332f7b3 service nova] Creating event network-changed:b140609b-8045-491e-ae95-a4805fec9a84 for instance 875dc635-0c80-400a-9a7f-92998b74fcd6 on hv-cinder-81322 Sep 09 13:10:12.683054 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-40773562-2b4e-41a7-9c8d-531f678ec3dc req-ff8f6831-31e2-413f-8c1e-cc9bd332f7b3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032253 Sep 09 13:10:12.683726 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 566/1121] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:10:13.654690 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-5915204c-c454-4cc7-9029-1fbb4c651a70 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:13.655219 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-5915204c-c454-4cc7-9029-1fbb4c651a70 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 875dc635-0c80-400a-9a7f-92998b74fcd6] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:13.662096 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5915204c-c454-4cc7-9029-1fbb4c651a70 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:13.662612 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5915204c-c454-4cc7-9029-1fbb4c651a70 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:13.663058 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5915204c-c454-4cc7-9029-1fbb4c651a70 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:13.663748 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5915204c-c454-4cc7-9029-1fbb4c651a70 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:13.664202 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5915204c-c454-4cc7-9029-1fbb4c651a70 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:13.664628 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5915204c-c454-4cc7-9029-1fbb4c651a70 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:13.794665 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-5915204c-c454-4cc7-9029-1fbb4c651a70 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:10:13.802834 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-5915204c-c454-4cc7-9029-1fbb4c651a70 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6" status: 200 len: 1314 microversion: 2.1 time: 0.152157 Sep 09 13:10:13.803395 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 556/1122] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:13 2022] GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:14.826440 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-536f3813-5077-49fd-a221-2d3e172da109 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:14.827155 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-536f3813-5077-49fd-a221-2d3e172da109 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 875dc635-0c80-400a-9a7f-92998b74fcd6] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:14.833762 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-536f3813-5077-49fd-a221-2d3e172da109 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:14.834246 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-536f3813-5077-49fd-a221-2d3e172da109 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:14.834709 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-536f3813-5077-49fd-a221-2d3e172da109 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:14.835396 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-536f3813-5077-49fd-a221-2d3e172da109 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:14.835848 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-536f3813-5077-49fd-a221-2d3e172da109 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:14.836526 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-536f3813-5077-49fd-a221-2d3e172da109 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:14.964124 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-536f3813-5077-49fd-a221-2d3e172da109 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:10:14.971954 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-536f3813-5077-49fd-a221-2d3e172da109 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6" status: 200 len: 1314 microversion: 2.1 time: 0.150262 Sep 09 13:10:14.972519 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 567/1123] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:14 2022] GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:15.995192 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-9aed899d-01b3-4908-80b1-4513acf84369 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:15.995813 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-9aed899d-01b3-4908-80b1-4513acf84369 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 875dc635-0c80-400a-9a7f-92998b74fcd6] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:16.002875 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9aed899d-01b3-4908-80b1-4513acf84369 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:16.003360 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9aed899d-01b3-4908-80b1-4513acf84369 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:16.003847 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9aed899d-01b3-4908-80b1-4513acf84369 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:16.004495 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9aed899d-01b3-4908-80b1-4513acf84369 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:16.004954 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9aed899d-01b3-4908-80b1-4513acf84369 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:16.005383 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-9aed899d-01b3-4908-80b1-4513acf84369 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:16.133766 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-9aed899d-01b3-4908-80b1-4513acf84369 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:10:16.142211 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-9aed899d-01b3-4908-80b1-4513acf84369 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6" status: 200 len: 1314 microversion: 2.1 time: 0.150876 Sep 09 13:10:16.142858 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 557/1124] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:15 2022] GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:17.164993 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-13fa0355-6183-425d-9390-84f88065a028 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:17.165624 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-13fa0355-6183-425d-9390-84f88065a028 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 875dc635-0c80-400a-9a7f-92998b74fcd6] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:17.172839 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-13fa0355-6183-425d-9390-84f88065a028 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:17.173357 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-13fa0355-6183-425d-9390-84f88065a028 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:17.173806 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-13fa0355-6183-425d-9390-84f88065a028 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:17.174522 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-13fa0355-6183-425d-9390-84f88065a028 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:17.174989 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-13fa0355-6183-425d-9390-84f88065a028 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:17.175425 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-13fa0355-6183-425d-9390-84f88065a028 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:17.304345 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-13fa0355-6183-425d-9390-84f88065a028 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:10:17.312468 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-13fa0355-6183-425d-9390-84f88065a028 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6" status: 200 len: 1314 microversion: 2.1 time: 0.150973 Sep 09 13:10:17.313037 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 568/1125] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:17 2022] GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:17.892583 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [req-0d51de0f-fe99-4525-902a-53a16ff0b774 req-0672b4ea-d1f0-4daf-ad4e-c43659d90e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "875dc635-0c80-400a-9a7f-92998b74fcd6", "name": "network-vif-plugged", "status": "completed", "tag": "b140609b-8045-491e-ae95-a4805fec9a84"}]} {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:10:17.902498 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-0d51de0f-fe99-4525-902a-53a16ff0b774 req-0672b4ea-d1f0-4daf-ad4e-c43659d90e41 service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:17.902994 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-0d51de0f-fe99-4525-902a-53a16ff0b774 req-0672b4ea-d1f0-4daf-ad4e-c43659d90e41 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:17.903441 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [req-0d51de0f-fe99-4525-902a-53a16ff0b774 req-0672b4ea-d1f0-4daf-ad4e-c43659d90e41 service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:17.914149 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.compute.server_external_events [req-0d51de0f-fe99-4525-902a-53a16ff0b774 req-0672b4ea-d1f0-4daf-ad4e-c43659d90e41 service nova] Creating event network-vif-plugged:b140609b-8045-491e-ae95-a4805fec9a84 for instance 875dc635-0c80-400a-9a7f-92998b74fcd6 on hv-cinder-81322 Sep 09 13:10:17.919698 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [req-0d51de0f-fe99-4525-902a-53a16ff0b774 req-0672b4ea-d1f0-4daf-ad4e-c43659d90e41 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030694 Sep 09 13:10:17.923613 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 558/1126] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:10:18.334755 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-a03fefa0-941b-4144-8e87-738e4b8b3b75 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:18.335380 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-a03fefa0-941b-4144-8e87-738e4b8b3b75 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 875dc635-0c80-400a-9a7f-92998b74fcd6] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:18.341938 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a03fefa0-941b-4144-8e87-738e4b8b3b75 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:18.342418 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a03fefa0-941b-4144-8e87-738e4b8b3b75 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:18.342891 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a03fefa0-941b-4144-8e87-738e4b8b3b75 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:18.344122 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a03fefa0-941b-4144-8e87-738e4b8b3b75 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:18.344572 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a03fefa0-941b-4144-8e87-738e4b8b3b75 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:18.344993 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-a03fefa0-941b-4144-8e87-738e4b8b3b75 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:18.482366 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-a03fefa0-941b-4144-8e87-738e4b8b3b75 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:10:18.490324 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-a03fefa0-941b-4144-8e87-738e4b8b3b75 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6" status: 200 len: 1314 microversion: 2.1 time: 0.159444 Sep 09 13:10:18.490919 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 569/1127] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:18 2022] GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:19.514018 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-5d3066ac-3d53-4bd3-8c8f-c3613d30b66a tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:19.514741 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-5d3066ac-3d53-4bd3-8c8f-c3613d30b66a tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 875dc635-0c80-400a-9a7f-92998b74fcd6] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:19.518078 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=2 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:19.519326 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell0:SELECT=6 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:19.524651 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5d3066ac-3d53-4bd3-8c8f-c3613d30b66a tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:19.525135 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5d3066ac-3d53-4bd3-8c8f-c3613d30b66a tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:19.525567 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5d3066ac-3d53-4bd3-8c8f-c3613d30b66a tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:19.526258 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5d3066ac-3d53-4bd3-8c8f-c3613d30b66a tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:19.526732 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5d3066ac-3d53-4bd3-8c8f-c3613d30b66a tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:19.540471 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-5d3066ac-3d53-4bd3-8c8f-c3613d30b66a tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:19.662112 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-5d3066ac-3d53-4bd3-8c8f-c3613d30b66a tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:10:19.669955 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-5d3066ac-3d53-4bd3-8c8f-c3613d30b66a tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6" status: 200 len: 1314 microversion: 2.1 time: 0.160168 Sep 09 13:10:19.670530 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 559/1128] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:19 2022] GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:20.693541 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-705e8d73-97e6-421f-89a6-ce1aef3b0452 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:20.694150 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-705e8d73-97e6-421f-89a6-ce1aef3b0452 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 875dc635-0c80-400a-9a7f-92998b74fcd6] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:20.696164 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell0:SELECT=2 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:20.701281 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-705e8d73-97e6-421f-89a6-ce1aef3b0452 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:20.701803 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-705e8d73-97e6-421f-89a6-ce1aef3b0452 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:20.706646 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-705e8d73-97e6-421f-89a6-ce1aef3b0452 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:20.706646 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-705e8d73-97e6-421f-89a6-ce1aef3b0452 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:20.706646 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-705e8d73-97e6-421f-89a6-ce1aef3b0452 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:20.706646 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-705e8d73-97e6-421f-89a6-ce1aef3b0452 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:20.832898 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-705e8d73-97e6-421f-89a6-ce1aef3b0452 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:10:20.840977 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-705e8d73-97e6-421f-89a6-ce1aef3b0452 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6" status: 200 len: 1498 microversion: 2.1 time: 0.151230 Sep 09 13:10:20.841535 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 570/1129] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:20 2022] GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6 => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:21.578548 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-4b924f67-3e13-4dcd-9a0c-e04bdb9597a2 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:21.579258 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-4b924f67-3e13-4dcd-9a0c-e04bdb9597a2 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 875dc635-0c80-400a-9a7f-92998b74fcd6] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:21.581440 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:21.586536 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4b924f67-3e13-4dcd-9a0c-e04bdb9597a2 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:21.587017 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4b924f67-3e13-4dcd-9a0c-e04bdb9597a2 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:21.587458 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4b924f67-3e13-4dcd-9a0c-e04bdb9597a2 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:21.588220 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4b924f67-3e13-4dcd-9a0c-e04bdb9597a2 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:21.588666 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4b924f67-3e13-4dcd-9a0c-e04bdb9597a2 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:21.589087 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-4b924f67-3e13-4dcd-9a0c-e04bdb9597a2 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:21.604542 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG dbcounter [-] [127772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:21.616737 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-4b924f67-3e13-4dcd-9a0c-e04bdb9597a2 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 875dc635-0c80-400a-9a7f-92998b74fcd6] Going to try to terminate instance {{(pid=127772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:10:21.879739 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-4b924f67-3e13-4dcd-9a0c-e04bdb9597a2 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "DELETE /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6" status: 204 len: 0 microversion: 2.1 time: 0.305476 Sep 09 13:10:21.880330 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 560/1130] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 13:10:21 2022] DELETE /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 13:10:21.892483 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-8ce73d90-42d3-4df1-a72d-90ad34587c0b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:21.893087 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-8ce73d90-42d3-4df1-a72d-90ad34587c0b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 875dc635-0c80-400a-9a7f-92998b74fcd6] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:21.899530 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8ce73d90-42d3-4df1-a72d-90ad34587c0b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:21.900021 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8ce73d90-42d3-4df1-a72d-90ad34587c0b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:21.900459 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8ce73d90-42d3-4df1-a72d-90ad34587c0b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:21.901149 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8ce73d90-42d3-4df1-a72d-90ad34587c0b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:21.901603 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8ce73d90-42d3-4df1-a72d-90ad34587c0b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:21.902023 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-8ce73d90-42d3-4df1-a72d-90ad34587c0b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:22.039800 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.policy [None req-8ce73d90-42d3-4df1-a72d-90ad34587c0b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:10:22.048248 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-8ce73d90-42d3-4df1-a72d-90ad34587c0b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6" status: 200 len: 1504 microversion: 2.1 time: 0.159687 Sep 09 13:10:22.048803 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 571/1131] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:21 2022] GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:23.071939 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-17c02b7b-26c1-4354-8955-d82e19a96716 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:23.072677 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-17c02b7b-26c1-4354-8955-d82e19a96716 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 875dc635-0c80-400a-9a7f-92998b74fcd6] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:23.080465 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-17c02b7b-26c1-4354-8955-d82e19a96716 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:23.080952 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-17c02b7b-26c1-4354-8955-d82e19a96716 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:23.081393 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-17c02b7b-26c1-4354-8955-d82e19a96716 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:23.082088 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-17c02b7b-26c1-4354-8955-d82e19a96716 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:23.083202 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-17c02b7b-26c1-4354-8955-d82e19a96716 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:23.083202 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-17c02b7b-26c1-4354-8955-d82e19a96716 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:23.269652 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-17c02b7b-26c1-4354-8955-d82e19a96716 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:10:23.277665 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-17c02b7b-26c1-4354-8955-d82e19a96716 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6" status: 200 len: 1504 microversion: 2.1 time: 0.210008 Sep 09 13:10:23.283172 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 561/1132] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:23 2022] GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6 => generated 1504 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:23.735682 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [req-ebe5f6b7-cb8d-40e1-a5b1-f11a3fabc8ce req-1e597027-eb82-49db-b340-d93cefa33afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "875dc635-0c80-400a-9a7f-92998b74fcd6", "name": "network-vif-deleted", "tag": "b140609b-8045-491e-ae95-a4805fec9a84"}]} {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:10:23.745562 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-ebe5f6b7-cb8d-40e1-a5b1-f11a3fabc8ce req-1e597027-eb82-49db-b340-d93cefa33afa service nova] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:23.746041 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-ebe5f6b7-cb8d-40e1-a5b1-f11a3fabc8ce req-1e597027-eb82-49db-b340-d93cefa33afa service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:23.746492 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [req-ebe5f6b7-cb8d-40e1-a5b1-f11a3fabc8ce req-1e597027-eb82-49db-b340-d93cefa33afa service nova] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:23.757779 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.compute.server_external_events [req-ebe5f6b7-cb8d-40e1-a5b1-f11a3fabc8ce req-1e597027-eb82-49db-b340-d93cefa33afa service nova] Creating event network-vif-deleted:b140609b-8045-491e-ae95-a4805fec9a84 for instance 875dc635-0c80-400a-9a7f-92998b74fcd6 on hv-cinder-81322 Sep 09 13:10:23.762714 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [req-ebe5f6b7-cb8d-40e1-a5b1-f11a3fabc8ce req-1e597027-eb82-49db-b340-d93cefa33afa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030792 Sep 09 13:10:23.763308 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 572/1133] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 13:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:10:24.302133 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.api.openstack.wsgi [None req-af27044d-bbc8-460f-9b58-d697cd50ee9b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:24.302779 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.compute.api [None req-af27044d-bbc8-460f-9b58-d697cd50ee9b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 875dc635-0c80-400a-9a7f-92998b74fcd6] Fetching instance by UUID {{(pid=127772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:24.309352 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-af27044d-bbc8-460f-9b58-d697cd50ee9b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:24.309883 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-af27044d-bbc8-460f-9b58-d697cd50ee9b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:24.310318 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-af27044d-bbc8-460f-9b58-d697cd50ee9b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:24.311031 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-af27044d-bbc8-460f-9b58-d697cd50ee9b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:24.311485 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-af27044d-bbc8-460f-9b58-d697cd50ee9b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:24.311942 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-af27044d-bbc8-460f-9b58-d697cd50ee9b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:24.345812 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-af27044d-bbc8-460f-9b58-d697cd50ee9b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:24.346291 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-af27044d-bbc8-460f-9b58-d697cd50ee9b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:24.346751 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG oslo_concurrency.lockutils [None req-af27044d-bbc8-460f-9b58-d697cd50ee9b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:24.347192 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.objects.instance [None req-af27044d-bbc8-460f-9b58-d697cd50ee9b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lazy-loading 'fault' on Instance uuid 875dc635-0c80-400a-9a7f-92998b74fcd6 {{(pid=127772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:10:24.389011 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: DEBUG nova.policy [None req-af27044d-bbc8-460f-9b58-d697cd50ee9b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a1e89f834a495eb4f061eee7fd1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813d39a2302342b18a9316581fa3a14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:10:24.397225 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: INFO nova.api.openstack.requestlog [None req-af27044d-bbc8-460f-9b58-d697cd50ee9b tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6" status: 200 len: 1304 microversion: 2.1 time: 0.099043 Sep 09 13:10:24.397779 dv-cinder-813229-14-iscsi devstack@n-api.service[127772]: [pid: 127772|app: 0|req: 562/1134] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:24 2022] GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:25.426433 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e7088863-28f9-4456-b4db-7cb3e498b6a5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Calling method '>' {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:10:25.427075 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.compute.api [None req-e7088863-28f9-4456-b4db-7cb3e498b6a5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] [instance: 875dc635-0c80-400a-9a7f-92998b74fcd6] Fetching instance by UUID {{(pid=127771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:10:25.429653 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_api:SELECT=44 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:25.434591 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e7088863-28f9-4456-b4db-7cb3e498b6a5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:25.435076 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e7088863-28f9-4456-b4db-7cb3e498b6a5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:25.435518 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e7088863-28f9-4456-b4db-7cb3e498b6a5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:25.436292 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e7088863-28f9-4456-b4db-7cb3e498b6a5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Acquiring lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:10:25.436701 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e7088863-28f9-4456-b4db-7cb3e498b6a5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:10:25.437764 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG oslo_concurrency.lockutils [None req-e7088863-28f9-4456-b4db-7cb3e498b6a5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Lock "d5b125c4-b69c-4216-8126-4e61782bc3cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:10:25.440369 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG dbcounter [-] [127771] Writing DB stats nova_cell1:SELECT=80 {{(pid=127771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:25.451738 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.wsgi [None req-e7088863-28f9-4456-b4db-7cb3e498b6a5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] HTTP exception thrown: Instance 875dc635-0c80-400a-9a7f-92998b74fcd6 could not be found. Sep 09 13:10:25.454019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e7088863-28f9-4456-b4db-7cb3e498b6a5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Request method failure captured: Sep 09 13:10:25.454019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: request: GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6 HTTP/1.1 Sep 09 13:10:25.454019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept: application/json Sep 09 13:10:25.454019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Accept-Encoding: identity Sep 09 13:10:25.454019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Connection: close Sep 09 13:10:25.454019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Length: 0 Sep 09 13:10:25.454019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Content-Type: application/json Sep 09 13:10:25.454019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Host: 10.222.0.46 Sep 09 13:10:25.454019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: Openstack-System-Scope: None Sep 09 13:10:25.454019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: User-Agent: python-urllib3/1.26.12 Sep 09 13:10:25.454019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Auth-Token: gAAAAABjGzsdIgM-vm4MeHKRcEWdshzVjCUp57a0XeRhliDZe3uwoqWLJ0JJPfzTsJcMZosDYCqdCAr1q6Pebd4EN1s1olMo-NH1EWOkqz2JaWMRZfxPYX7LRGB7AKWLEvWBw5Rhgxge-AhvrHq96QeRarv-bcDk7K98VbghXqj_Sa3GYFEYhDY Sep 09 13:10:25.454019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Id: None Sep 09 13:10:25.454019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Domain-Name: None Sep 09 13:10:25.454019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Identity-Status: Confirmed Sep 09 13:10:25.454019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Is-Admin-Project: True Sep 09 13:10:25.454019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Id: default Sep 09 13:10:25.454019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Domain-Name: Default Sep 09 13:10:25.454019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Id: 813d39a2302342b18a9316581fa3a14e Sep 09 13:10:25.454019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Project-Name: tempest-VolumesActionsTest-756758309 Sep 09 13:10:25.454019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Role: member,reader Sep 09 13:10:25.454019 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Roles: member,reader Sep 09 13:10:25.455842 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/813d39a2302342b18a9316581fa3a14e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_813d39a2302342b18a9316581fa3a14e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/813d39a2302342b18a9316581fa3a14e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/813d39a2302342b18a9316581fa3a14e"}]}] Sep 09 13:10:25.455842 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant: tempest-VolumesActionsTest-756758309 Sep 09 13:10:25.455842 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Id: 813d39a2302342b18a9316581fa3a14e Sep 09 13:10:25.455842 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-Tenant-Name: tempest-VolumesActionsTest-756758309 Sep 09 13:10:25.455842 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User: tempest-VolumesActionsTest-756758309-project Sep 09 13:10:25.455842 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Id: default Sep 09 13:10:25.455842 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Domain-Name: Default Sep 09 13:10:25.455842 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Id: 89a1e89f834a495eb4f061eee7fd1676 Sep 09 13:10:25.455842 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: X-User-Name: tempest-VolumesActionsTest-756758309-project Sep 09 13:10:25.455842 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: method: > Sep 09 13:10:25.455842 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: exception: Instance 875dc635-0c80-400a-9a7f-92998b74fcd6 could not be found. Sep 09 13:10:25.455842 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: action_args: {'id': '875dc635-0c80-400a-9a7f-92998b74fcd6'} Sep 09 13:10:25.456992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: {{(pid=127771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:10:25.456992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:10:25.456992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:10:25.456992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:10:25.456992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:10:25.456992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:10:25.456992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:10:25.456992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:10:25.456992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:10:25.456992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:10:25.456992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 875dc635-0c80-400a-9a7f-92998b74fcd6 could not be found. Sep 09 13:10:25.456992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:10:25.456992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:10:25.456992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:10:25.456992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:10:25.456992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:10:25.456992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:10:25.456992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:10:25.456992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:10:25.456992 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:10:25.458585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:10:25.458585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:10:25.458585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:10:25.458585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:10:25.458585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:10:25.458585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:10:25.458585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:10:25.458585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 875dc635-0c80-400a-9a7f-92998b74fcd6 could not be found. Sep 09 13:10:25.458585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:10:25.458585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:10:25.458585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:10:25.458585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:10:25.458585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:10:25.458585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:10:25.458585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:10:25.458585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:10:25.458585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 875dc635-0c80-400a-9a7f-92998b74fcd6 could not be found. Sep 09 13:10:25.458585 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: ERROR nova.api.openstack.wsgi Sep 09 13:10:25.460261 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: DEBUG nova.api.openstack.wsgi [None req-e7088863-28f9-4456-b4db-7cb3e498b6a5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] Returning 404 to user: Instance 875dc635-0c80-400a-9a7f-92998b74fcd6 could not be found. {{(pid=127771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:10:25.460261 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: INFO nova.api.openstack.requestlog [None req-e7088863-28f9-4456-b4db-7cb3e498b6a5 tempest-VolumesActionsTest-756758309 tempest-VolumesActionsTest-756758309-project] 10.222.0.46 "GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6" status: 404 len: 111 microversion: 2.1 time: 0.034026 Sep 09 13:10:25.460261 dv-cinder-813229-14-iscsi devstack@n-api.service[127771]: [pid: 127771|app: 0|req: 573/1135] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 13:10:25 2022] GET /compute/v2.1/servers/875dc635-0c80-400a-9a7f-92998b74fcd6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)